Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-vzg9x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-vzg9x to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht to ip-10-0-132-177.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7fcdb566-g2dj9

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7fcdb566-g2dj9 to ip-10-0-136-249.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7fcdb566-czqtv

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7fcdb566-czqtv to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f to ip-10-0-139-174.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7fcdb566-4thqx

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7fcdb566-4thqx to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-657b74449cw6hzd

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-657b74449cw6hzd to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24

Scheduled

Successfully assigned openshift-ingress/e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-935bafe7-openshift-default-59686589bf-67tkq to ip-10-0-132-177.us-west-1.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-wvgmm

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-wvgmm to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb to ip-10-0-132-177.us-west-1.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-w8545

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-w8545 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5-qmpq4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5-qmpq4 to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-kzt5t

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kzt5t to ip-10-0-139-174.us-west-1.compute.internal

openshift-jobset-operator

jobset-controller-manager-54fffd6cd-nfdvt

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-54fffd6cd-nfdvt to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

test-curl-7918-f3eb51

Scheduled

Successfully assigned opendatahub/test-curl-7918-f3eb51 to ip-10-0-136-249.us-west-1.compute.internal

opendatahub

test-curl-7918-d973bf

Scheduled

Successfully assigned opendatahub/test-curl-7918-d973bf to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd to ip-10-0-136-249.us-west-1.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-h6wb8

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-h6wb8 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc to ip-10-0-136-249.us-west-1.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-xnjmn

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-xnjmn to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh to ip-10-0-139-174.us-west-1.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-zclgc

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-zclgc to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm to ip-10-0-132-177.us-west-1.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-w8xgw

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-w8xgw to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl to ip-10-0-132-177.us-west-1.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2dzg

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2dzg to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-phf8w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-phf8w to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

test-curl-7918-2eb58d

Scheduled

Successfully assigned opendatahub/test-curl-7918-2eb58d to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

router-default-6596c66c9c-vvjzz

Scheduled

Successfully assigned openshift-ingress/router-default-6596c66c9c-vvjzz to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

router-default-6596c66c9c-vvjzz

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-6596c66c9c-vvjzz

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-acd385-855d746459-22n57

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-acd385-855d746459-22n57 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-ec695b-c894f84b9-jxm6h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-ec695b-c894f84b9-jxm6h to ip-10-0-132-177.us-west-1.compute.internal

opendatahub

test-curl-7909-9cb945

Scheduled

Successfully assigned opendatahub/test-curl-7909-9cb945 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-gvg2l

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gvg2l to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-vhmdw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vhmdw to ip-10-0-139-174.us-west-1.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-9xsbq

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-9xsbq to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-e621db-68d4bc4bc5-hrkvn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-e621db-68d4bc4bc5-hrkvn to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-7d58c8f9d5-2hkws

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d58c8f9d5-2hkws to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-7d58c8f9d5-52lbx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d58c8f9d5-52lbx to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-6xjn4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-6xjn4 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-79dvv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-79dvv to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-9ngbl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-9ngbl to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-g7nhb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-g7nhb to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-noten-d39811-openshift-default-6898949c8f-pl68h

Scheduled

Successfully assigned openshift-ingress/e2e-noten-d39811-openshift-default-6898949c8f-pl68h to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-gbwwl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-gbwwl to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-r6vw8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-r6vw8 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f259852e-openshift-default-74d46457c-lhkcq to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-sxrp7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-sxrp7 to ip-10-0-139-174.us-west-1.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-zccpv

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-zccpv to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-tgg84

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-tgg84 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-97b317-d84d9dc99-5qs45

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-97b317-d84d9dc99-5qs45 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-26fbc4-755d5d844f-4mvrj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-26fbc4-755d5d844f-4mvrj to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-w2k74

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-w2k74 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-xgs9d

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-xgs9d to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fc8c56547-zzqhf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fc8c56547-zzqhf to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-58ktl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-58ktl to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll to ip-10-0-136-249.us-west-1.compute.internal

opendatahub

test-curl-7909-76f1c5

Scheduled

Successfully assigned opendatahub/test-curl-7909-76f1c5 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-n5j7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-n5j7l to ip-10-0-139-174.us-west-1.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-nwj76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-nwj76 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-zxrm2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-zxrm2 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-zcbtp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-zcbtp to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-mgw65

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-mgw65 to ip-10-0-132-177.us-west-1.compute.internal

opendatahub

test-curl-7906-a0e3ce

Scheduled

Successfully assigned opendatahub/test-curl-7906-a0e3ce to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-7g4gj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-7g4gj to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-r89bd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-r89bd to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-d867bb-5d86c66f99-7zbt9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-d867bb-5d86c66f99-7zbt9 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-ade881-559866dbc9-wck74

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ade881-559866dbc9-wck74 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz to ip-10-0-132-177.us-west-1.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-6tnqv

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-6tnqv to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-dmjmv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-dmjmv to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-gsgsp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-gsgsp to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc-mbwcg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc-mbwcg to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-935bafe7-57c8cd995f-ch8kn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-935bafe7-57c8cd995f-ch8kn to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9-jqz9v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9-jqz9v to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f-9jbmm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f-9jbmm to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f-skts5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f-skts5 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f57e85-589c46599-f7427

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f57e85-589c46599-f7427 to ip-10-0-132-177.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-79d4cb79bf-2zf4s

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-79d4cb79bf-2zf4s to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc-4knvr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc-4knvr to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7870b4-7567f9cd47-rxsg7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7870b4-7567f9cd47-rxsg7 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-n7f8l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-n7f8l to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5-w5p9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5-w5p9s to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-d50516-74646775f-znft5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-d50516-74646775f-znft5 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f-kbdvf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f-kbdvf to ip-10-0-139-174.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-79f6ffb7fd-svtt6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-79f6ffb7fd-svtt6 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c12708-857bb95bf9-nv9tg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c12708-857bb95bf9-nv9tg to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5-rfthr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5-rfthr to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7-lrhfr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7-lrhfr to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c-fr5ck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c-fr5ck to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5-nl77f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5-nl77f to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47-6rsdk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47-6rsdk to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495-nmrh2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495-nmrh2 to ip-10-0-136-249.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-7cb69c85f-fjhzf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7cb69c85f-fjhzf to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f-92kzl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f-92kzl to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9-z897c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9-z897c to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf-ndwwr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf-ndwwr to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9-vwmww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9-vwmww to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79-r9s4r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79-r9s4r to ip-10-0-132-177.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-7cb69c85f-shtfn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7cb69c85f-shtfn to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c-7whk5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c-7whk5 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75-fvj9r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75-fvj9r to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf-mqshj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf-mqshj to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9-7bvnz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9-7bvnz to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5-9cm2r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5-9cm2r to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467-lzj7k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467-lzj7k to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779-s5mpf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779-s5mpf to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f-fg5nl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f-fg5nl to ip-10-0-132-177.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-7fb874b485-9dxqg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7fb874b485-9dxqg to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579-n46z9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579-n46z9 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-76aba6-64bcd7599f-r42lj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-76aba6-64bcd7599f-r42lj to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-648fc44f87-p9ptl

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-648fc44f87-p9ptl to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-3f0818-679c745975-jvkr7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3f0818-679c745975-jvkr7 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff-t6898

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff-t6898 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-634135-8cd476b87-s6c5k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-634135-8cd476b87-s6c5k to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-ctlqq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-ctlqq to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf-xhjnp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf-xhjnp to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-82zx2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-82zx2 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f-zr5g5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f-zr5g5 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-f8mwt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f259852e-d98c8f67f-f8mwt to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-txkrm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f259852e-d98c8f67f-txkrm to ip-10-0-132-177.us-west-1.compute.internal

cert-manager

cert-manager-597b95cb84-tbnvv

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-tbnvv to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659-ndnnd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659-ndnnd to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-hh4nk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-hh4nk to ip-10-0-132-177.us-west-1.compute.internal

opendatahub

ai-gateway-controller-6bb949dc9c-x6t7p

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6bb949dc9c-x6t7p to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79-kbxkf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79-kbxkf to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7-5p9l8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7-5p9l8 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c-mjj4v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c-mjj4v to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767-nm2vs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767-nm2vs to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9-xlmdb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9-xlmdb to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675-hd65w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675-hd65w to ip-10-0-136-249.us-west-1.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-77hxg

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-77hxg to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-2pw7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-2pw7f to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-hbf2d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-hbf2d to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-jj44t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-jj44t to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-9grfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-9grfz to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-jstb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-jstb5 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-pbrqh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-pbrqh to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-8lmh6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-8lmh6 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-q5wdq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-q5wdq to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-pbrf4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-pbrf4 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-97b317-7878778ccf-9fc6g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-97b317-7878778ccf-9fc6g to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-e621db-55897f959-crnct

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-e621db-55897f959-crnct to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-skln4

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-skln4 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-mz9ck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-mz9ck to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-2k7jz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-2k7jz to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-vl9ww

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-vl9ww to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-20f0d1b6-668d67955c-mhqqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-20f0d1b6-668d67955c-mhqqt to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-a713e6-openshift-default-686545875c-59f22

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a713e6-openshift-default-686545875c-59f22 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf-cwgxz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf-cwgxz to ip-10-0-132-177.us-west-1.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-vvttm

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-vvttm to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-935bafe7-fdd4b6f47-tfh7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-935bafe7-fdd4b6f47-tfh7l to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-02c8fd-77c5488457-l9xvx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-02c8fd-77c5488457-l9xvx to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-4bcda6-64d5569cf-mjvdg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4bcda6-64d5569cf-mjvdg to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-88d9b8-7ff746ff97-nf6tc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-88d9b8-7ff746ff97-nf6tc to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-f57e85-578955bf55-4wf7g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f57e85-578955bf55-4wf7g to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-3f72e4-7889d697c5-wshr9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-3f72e4-7889d697c5-wshr9 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-7870b4-5597b7945c-tj6cw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7870b4-5597b7945c-tj6cw to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-987f2f-869dbf49-t5zdp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-987f2f-869dbf49-t5zdp to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-d6b8ff-58745646fc-2mxhx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d6b8ff-58745646fc-2mxhx to ip-10-0-132-177.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-bgs5p

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-bgs5p to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-autores-d50516-bc99c4787-bv9c7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-d50516-bc99c4787-bv9c7 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-derive-79f7219a-5ffd85f9-gp4cv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-79f7219a-5ffd85f9-gp4cv to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-explicit-c12708-6b559dfb79-cllsf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c12708-6b559dfb79-cllsf to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-6c6990-6666c66857-9z5gw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-6c6990-6666c66857-9z5gw to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-6caf19-7567445fcf-5x4fd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-6caf19-7567445fcf-5x4fd to ip-10-0-136-249.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-t2f7q

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-t2f7q to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-864622-6df6b698c-kfxl4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-864622-6df6b698c-kfxl4 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-a713e6-57b7d787df-xlrvf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a713e6-57b7d787df-xlrvf to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f-z4997

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f-z4997 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-8a35f7-594c6b5865-mnvjb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-8a35f7-594c6b5865-mnvjb to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-b91499-697b648765-58gq7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-b91499-697b648765-58gq7 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-bbe5e0-f6448875f-b8nfx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-bbe5e0-f6448875f-b8nfx to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-caff19-58756c467c-mzgnw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-caff19-58756c467c-mzgnw to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-fbe06f-97c787bd7-5tbv8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-fbe06f-97c787bd7-5tbv8 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-6c7db9-5645df674c-lc7b4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6c7db9-5645df674c-lc7b4 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-6c7db9-84d975d5bd-r8479

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6c7db9-84d975d5bd-r8479 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc-5wvsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc-5wvsj to ip-10-0-132-177.us-west-1.compute.internal

opendatahub

maas-controller-6887cffc9f-lvrkf

Scheduled

Successfully assigned opendatahub/maas-controller-6887cffc9f-lvrkf to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd-62dmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd-62dmm to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6-p4jqd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6-p4jqd to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-b95dca-f77b8dc7-qh7nx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b95dca-f77b8dc7-qh7nx to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c12708-openshift-default-64449fc95c-lv54p to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

Scheduled

Successfully assigned openshift-ingress/e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-c9da8f-67bb794556-gpdnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c9da8f-67bb794556-gpdnf to ip-10-0-132-177.us-west-1.compute.internal

opendatahub

maas-controller-7668b86557-dm49w

Scheduled

Successfully assigned opendatahub/maas-controller-7668b86557-dm49w to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5-brxdq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5-brxdq to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf-7ghg8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf-7ghg8 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-pdv8p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-pdv8p to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-0ea963-59b8874fcb-65mvw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0ea963-59b8874fcb-65mvw to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-0ea963-999665dc5-772kv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0ea963-999665dc5-772kv to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-3f0818-55fdff8547-jpvnj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3f0818-55fdff8547-jpvnj to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb-28gh9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb-28gh9 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-634135-56686b8fcb-crwc4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-634135-56686b8fcb-crwc4 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-634135-6c54f6fdbc-nkpz4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-634135-6c54f6fdbc-nkpz4 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6-xzmzn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6-xzmzn to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a31828-7c64bcbb89-nn7fb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a31828-7c64bcbb89-nn7fb to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw

Scheduled

Successfully assigned openshift-ingress/e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw to ip-10-0-136-249.us-west-1.compute.internal

opendatahub

model-serving-api-75bd89fdfc-km9nx

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-km9nx to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c0359f-786c8479-t5j58

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c0359f-786c8479-t5j58 to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-migrate-60c85e15-749d76b855-zk9ml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-60c85e15-749d76b855-zk9ml to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-mt-f259852e-57b4666f87-fr5w2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f259852e-57b4666f87-fr5w2 to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-mt-f259852e-57b4666f87-rwvnm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f259852e-57b4666f87-rwvnm to ip-10-0-132-177.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-0c0723-757b66d6df-tb7m9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-0c0723-757b66d6df-tb7m9 to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-jrgkf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-jrgkf to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-001a26-67b644b4f-l8bms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-001a26-67b644b4f-l8bms to ip-10-0-132-177.us-west-1.compute.internal

opendatahub

odh-model-controller-769875db56-2j77z

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-2j77z to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-66100b-855b664dd9-ljdvj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-66100b-855b664dd9-ljdvj to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-6a9710-68dc7c4d55-wptrv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-6a9710-68dc7c4d55-wptrv to ip-10-0-136-249.us-west-1.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6596c66c9c from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-6596c66c9c

SuccessfulCreate

Created pod: router-default-6596c66c9c-vvjzz
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-6596c66c9c-vvjzz

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-6596c66c9c-vvjzz

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-6596c66c9c-vvjzz

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-6596c66c9c-vvjzz

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-6596c66c9c-vvjzz

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6596c66c9c-vvjzz

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-6596c66c9c-vvjzz

Started

Container started

openshift-ingress

kubelet

router-default-6596c66c9c-vvjzz

Created

Container created

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-phf8w

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-phf8w

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-phf8w

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-phf8w

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-phf8w

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-phf8w

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 5.21s (5.21s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-phf8w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-phf8w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fc8c56547-tgg84

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-648fc44f87 from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-648fc44f87

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-648fc44f87-p9ptl

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fc8c56547 from 0 to 1

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-648fc44f87-p9ptl

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-tgg84

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-648fc44f87-p9ptl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-648fc44f87-p9ptl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 10.371s (10.371s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-648fc44f87-p9ptl

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-648fc44f87-p9ptl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 10.133s (10.133s including waiting). Image size: 183555333 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7fcdb566

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7fcdb566-czqtv

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-7fcdb566 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7fcdb566

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7fcdb566-4thqx

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7fcdb566

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7fcdb566-g2dj9

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7fcdb566-4thqx

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-g2dj9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7fcdb566-g2dj9

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-czqtv

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7fcdb566-czqtv

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.546s (3.546s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-g2dj9

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-g2dj9

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-czqtv

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.421s (3.421s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-g2dj9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.38s (3.38s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-czqtv

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-czqtv

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-g2dj9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-g2dj9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 893ms (893ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-g2dj9

Created

Container created
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 838ms (838ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-g2dj9

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-czqtv

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 822ms (822ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

opendatahub-operator-controller-manager-7fcdb566-g2dj9_e95ff508-b4eb-419c-abcc-9969776826d2

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-7fcdb566-g2dj9_e95ff508-b4eb-419c-abcc-9969776826d2 became leader
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-69b7m

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found
(x7)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-wvgmm

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-wvgmm

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-wvgmm

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-6tnqv

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-6tnqv

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-6tnqv

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-czqtv

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-wvgmm

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.416s (4.416s including waiting). Image size: 309650901 bytes.
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-czqtv

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 847ms (848ms including waiting). Image size: 273709574 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-wvgmm

Started

Container started
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-czqtv

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-czqtv

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 796ms (796ms including waiting). Image size: 273709574 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-wvgmm

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-6tnqv

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.518s (3.518s including waiting). Image size: 309650901 bytes.

cert-manager

multus

cert-manager-597b95cb84-tbnvv

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-tbnvv

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-tbnvv

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-tbnvv

Started

Container started

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-tbnvv

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

BackOff

Back-off restarting failed container manager in pod opendatahub-operator-controller-manager-7fcdb566-4thqx_opendatahub-operator-system(a6a5abcb-bbb5-4e56-ac90-0bf956d2e78d)
(x2)

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-6tnqv

Created

Container created
(x2)

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-6tnqv

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-6tnqv

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod
(x3)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x3)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Started

Container started
(x3)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7fcdb566-4thqx

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 1.264s (1.264s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-w8545

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-w8545

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-w8545

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-w8545

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.967s (3.967s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-w8545

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-w8545

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-w8545_a01808f9-a5e6-46f7-9b31-5534a6021435 became leader

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-xwr8k"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-8cdmr"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-7d58c8f9d5-2hkws

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-657b74449c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-657b74449cw6hzd

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-657b74449c from 0 to 1

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d58c8f9d5 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7d58c8f9d5

SuccessfulCreate

Created pod: kube-auth-proxy-7d58c8f9d5-52lbx

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-ingress

replicaset-controller

kube-auth-proxy-7d58c8f9d5

SuccessfulCreate

Created pod: kube-auth-proxy-7d58c8f9d5-2hkws

openshift-ingress

kubelet

kube-auth-proxy-7d58c8f9d5-52lbx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-ingress

multus

kube-auth-proxy-7d58c8f9d5-2hkws

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7d58c8f9d5-52lbx

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-657b74449cw6hzd

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-657b74449cw6hzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-657b74449cw6hzd

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-657b74449cw6hzd

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-54fffd6cd

SuccessfulCreate

Created pod: jobset-controller-manager-54fffd6cd-nfdvt

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-54fffd6cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-7d58c8f9d5-2hkws

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-7d58c8f9d5-2hkws

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.98s (2.98s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d58c8f9d5-2hkws

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-7d58c8f9d5-52lbx

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7d58c8f9d5-52lbx

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7d58c8f9d5-52lbx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.028s (3.028s including waiting). Image size: 188904677 bytes.

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-54fffd6cd-nfdvt

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

multus

jobset-controller-manager-54fffd6cd-nfdvt

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-54fffd6cd-nfdvt

Created

Container created

openshift-jobset-operator

jobset-controller-manager-54fffd6cd-nfdvt_605d9c37-de1c-4223-bb47-4b625117cf15

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-54fffd6cd-nfdvt_605d9c37-de1c-4223-bb47-4b625117cf15 became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-54fffd6cd-nfdvt

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-54fffd6cd-nfdvt

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.766s (3.766s including waiting). Image size: 182184678 bytes.

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-vvttm

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-vvttm

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-vvttm

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-vvttm

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-vvttm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.911s (2.911s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-vvttm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-vvttm

Unhealthy

Liveness probe failed: Get "http://10.132.0.46:8081/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub

kserve-module-controller-manager-7566cf5fc8-vvttm_5d67a06d-d43d-4f56-be89-43469249ea7e

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-vvttm_5d67a06d-d43d-4f56-be89-43469249ea7e became leader

opendatahub

replicaset-controller

maas-controller-6887cffc9f

SuccessfulCreate

Created pod: maas-controller-6887cffc9f-lvrkf

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-6887cffc9f from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7668b86557 from 0 to 1

opendatahub

replicaset-controller

maas-controller-7668b86557

SuccessfulCreate

Created pod: maas-controller-7668b86557-dm49w

opendatahub

kubelet

maas-controller-7668b86557-dm49w

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:372660ad1cd9e3742cf2b66b8d16be89ca1def70bae9394b9a72cc5b5b64825f"

opendatahub

multus

maas-controller-7668b86557-dm49w

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

opendatahub

multus

maas-controller-6887cffc9f-lvrkf

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-6887cffc9f-lvrkf

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:372660ad1cd9e3742cf2b66b8d16be89ca1def70bae9394b9a72cc5b5b64825f"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gvg2l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-gvg2l

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-gvg2l

opendatahub

multus

kserve-controller-manager-776cc66d47-skln4

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gvg2l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.613s (4.613s including waiting). Image size: 185476477 bytes.

opendatahub

kubelet

maas-controller-7668b86557-dm49w

Created

Container created

opendatahub

kubelet

maas-controller-7668b86557-dm49w

Started

Container started

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-t2f7q

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-skln4

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-2j77z

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

kubelet

maas-controller-7668b86557-dm49w

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:372660ad1cd9e3742cf2b66b8d16be89ca1def70bae9394b9a72cc5b5b64825f" in 6.837s (6.838s including waiting). Image size: 200069652 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gvg2l

Started

Container started

opendatahub

kubelet

maas-controller-6887cffc9f-lvrkf

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gvg2l

Created

Container created

opendatahub

kubelet

maas-controller-6887cffc9f-lvrkf

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:372660ad1cd9e3742cf2b66b8d16be89ca1def70bae9394b9a72cc5b5b64825f" in 6.164s (6.164s including waiting). Image size: 200069652 bytes.

opendatahub

kubelet

maas-controller-6887cffc9f-lvrkf

Created

Container created

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-km9nx

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gvg2l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

odh-model-controller-769875db56-2j77z

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-2j77z

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gvg2l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

model-serving-api-75bd89fdfc-km9nx

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

model-serving-api-75bd89fdfc-km9nx

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-skln4

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-t2f7q

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t2f7q

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

maas-controller-6887cffc9f-lvrkf_504cc74b-a197-40b4-8bc3-efbc08dec06c

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6887cffc9f-lvrkf_504cc74b-a197-40b4-8bc3-efbc08dec06c became leader

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t2f7q

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-skln4

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.257s (3.257s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-km9nx

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-km9nx

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-skln4

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t2f7q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.523s (3.523s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t2f7q

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-skln4

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-km9nx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.177s (3.177s including waiting). Image size: 184925761 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-phf8w

Killing

Stopping container discovery

opendatahub

kubelet

odh-model-controller-769875db56-2j77z

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-kzt5t

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-kzt5t

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-phf8w

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-kzt5t

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

kubelet

odh-model-controller-769875db56-2j77z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.957s (3.957s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-2j77z

Created

Container created

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-kzt5t

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

opendatahub

llmisvc-controller-manager-869d5dcc5d-t2f7q_2e1995e5-90f1-490d-b345-925bfe5afcd7

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-t2f7q_2e1995e5-90f1-490d-b345-925bfe5afcd7 became leader

opendatahub

odh-model-controller-769875db56-2j77z_416a8ce9-4c5b-402c-9fb4-eb1d69c71137

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-2j77z_416a8ce9-4c5b-402c-9fb4-eb1d69c71137 became leader

opendatahub

kserve-controller-manager-776cc66d47-skln4_dbecf65c-0f8f-4ee4-8aae-895ac3fb5350

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-skln4_dbecf65c-0f8f-4ee4-8aae-895ac3fb5350 became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-kzt5t

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

replicaset-controller

maas-controller-7668b86557

SuccessfulDelete

Deleted pod: maas-controller-7668b86557-dm49w

opendatahub

kubelet

maas-controller-7668b86557-dm49w

Killing

Stopping container manager

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7668b86557 from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-kzt5t

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-kzt5t

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-kzt5t

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 12.5s (12.5s including waiting). Image size: 1089502687 bytes.
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-bgs5p

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-bgs5p

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-bgs5p

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-bgs5p

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-bgs5p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 703ms (703ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-bgs5p

Started

Container started

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-t2f7q

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t2f7q

Killing

Stopping container manager

opendatahub

kubelet

ai-gateway-controller-7d85675f98-77hxg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-77hxg

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

multus

ai-gateway-controller-7d85675f98-77hxg

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-77hxg

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-77hxg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.144s (2.144s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-77hxg

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-77hxg_6de2e960-9d34-42a7-ae92-c486cb0ba7c9

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-77hxg_6de2e960-9d34-42a7-ae92-c486cb0ba7c9 became leader
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6bb949dc9c from 0 to 1

opendatahub

kubelet

ai-gateway-controller-6bb949dc9c-x6t7p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-dmjmv

opendatahub

replicaset-controller

ai-gateway-controller-6bb949dc9c

SuccessfulCreate

Created pod: ai-gateway-controller-6bb949dc9c-x6t7p

opendatahub

multus

ai-gateway-controller-6bb949dc9c-x6t7p

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

multus

payload-processing-55fbbbf9dc-vl9ww

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-dmjmv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-vl9ww

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

opendatahub

kubelet

ai-gateway-controller-6bb949dc9c-x6t7p

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6bb949dc9c-x6t7p

Created

Container created

openshift-ingress

multus

payload-pre-processing-7b98bb678c-dmjmv

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-6bb949dc9c-x6t7p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 848ms (848ms including waiting). Image size: 183979433 bytes.

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-vl9ww

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-vl9ww

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-dmjmv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-dmjmv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-dmjmv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.848s (2.848s including waiting). Image size: 125353965 bytes.

opendatahub

llmisvc-controller-manager-6466c554d8-bgs5p_a22559b1-a038-447f-a89c-0bd42c30933a

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-bgs5p_a22559b1-a038-447f-a89c-0bd42c30933a became leader

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-vl9ww

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-vl9ww

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.698s (2.698s including waiting). Image size: 125353965 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-77hxg

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-77hxg

opendatahub

ai-gateway-controller-6bb949dc9c-x6t7p_070e27a3-6075-4f7b-8908-095e977fa537

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6bb949dc9c-x6t7p_070e27a3-6075-4f7b-8908-095e977fa537 became leader

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-h6wb8

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-h6wb8

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-h6wb8

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-h6wb8

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.92s (1.92s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-h6wb8

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-h6wb8

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xnjmn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-xnjmn

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-xnjmn

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xnjmn

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xnjmn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 573ms (573ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xnjmn

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-zclgc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-zclgc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-zclgc

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-zclgc

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-zclgc

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-zclgc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 578ms (578ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-w8xgw

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-w8xgw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-w8xgw

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-w8xgw

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-w8xgw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 581ms (581ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-w8xgw

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2dzg

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2dzg

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2dzg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2dzg

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2dzg

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2dzg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.737s (1.737s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-9xsbq

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

kubelet

echo-simulator-kserve-64b6f8f96c-9xsbq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-9xsbq

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-9xsbq

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-9xsbq

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-9xsbq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.374s (2.374s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-zccpv

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-zccpv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-zccpv

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-zccpv

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-zccpv

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-zccpv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 581ms (581ms including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fc8c56547 from 1 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fc8c56547-9ngbl

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fc8c56547-6xjn4

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-6xjn4

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-6xjn4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-9ngbl

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 586ms (586ms including waiting). Image size: 98346788 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-9ngbl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-6xjn4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-9ngbl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.948s (3.948s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-6xjn4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-9ngbl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-9ngbl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-6xjn4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.909s (3.909s including waiting). Image size: 183555333 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-9ngbl

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-6xjn4

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-6xjn4

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-9ngbl

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fc8c56547-r6vw8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-r6vw8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-r6vw8

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-r6vw8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-r6vw8

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-r6vw8

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-r6vw8

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

gateway_labeler_controller

e2e-ait-20f0d1b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-20f0d1b6

openshift-ingress

replicaset-controller

e2e-ait-20f0d1b6-openshift-default-567d5c7dc

SuccessfulCreate

Created pod: e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24

openshift-ingress

deployment-controller

e2e-ait-20f0d1b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-20f0d1b6-openshift-default-567d5c7dc from 0 to 1

openshift-ingress

multus

e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-79f7219a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-79f7219a

openshift-ingress

deployment-controller

e2e-derive-79f7219a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-79f7219a-openshift-default-d9947f8b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-79f7219a-openshift-default-d9947f8b9

SuccessfulCreate

Created pod: e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

openshift-ingress

deployment-controller

payload-processing-e2e-ait-20f0d1b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-20f0d1b6-668d67955c from 0 to 1

openshift-ingress

multus

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-20f0d1b6-668d67955c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-20f0d1b6-668d67955c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-20f0d1b6: serviceaccount "payload-processing-e2e-ait-20f0d1b6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-20f0d1b6-668d67955c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-20f0d1b6-668d67955c-mhqqt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-20f0d1b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-gsgsp
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-20f0d1b6: serviceaccount "payload-processing-e2e-ait-20f0d1b6" not found

openshift-ingress

gateway_labeler_controller

e2e-migrate-60c85e15-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-60c85e15-gw

openshift-ingress

deployment-controller

e2e-ait-935bafe7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-935bafe7-openshift-default-59686589bf from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-20f0d1b6-668d67955c-mhqqt

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-935bafe7-openshift-default-59686589bf

SuccessfulCreate

Created pod: e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

openshift-ingress

kubelet

payload-processing-e2e-ait-20f0d1b6-668d67955c-mhqqt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-gsgsp

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

gateway_labeler_controller

e2e-ait-935bafe7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-935bafe7

openshift-ingress

gateway_labeler_controller

e2e-ait-3d4f9b87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3d4f9b87

openshift-ingress

multus

payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-gsgsp

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-3d4f9b87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7 from 0 to 1

openshift-ingress

multus

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7

SuccessfulCreate

Created pod: e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v

openshift-ingress

multus

e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-60c85e15-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c

SuccessfulCreate

Created pod: e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

openshift-ingress

multus

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-gsgsp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.433s (3.433s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-gsgsp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-gsgsp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-20f0d1b6-668d67955c-mhqqt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.344s (3.345s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-20f0d1b6-668d67955c-mhqqt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-20f0d1b6-668d67955c-mhqqt

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-79f7219a-5ffd85f9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-79f7219a-5ffd85f9-gp4cv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-79f7219a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-79f7219a-5ffd85f9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-79f7219a-5ffd85f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-79f7219a: serviceaccount "payload-processing-e2e-derive-79f7219a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f-kbdvf

openshift-ingress

deployment-controller

payload-processing-e2e-derive-79f7219a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-79f7219a-5ffd85f9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-79f7219a: serviceaccount "payload-processing-e2e-derive-79f7219a" not found

openshift-ingress

multus

payload-processing-e2e-derive-79f7219a-5ffd85f9-gp4cv

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f-kbdvf

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f-kbdvf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-79f7219a-5ffd85f9-gp4cv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-79f7219a-5ffd85f9-gp4cv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-79f7219a-5ffd85f9-gp4cv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f-kbdvf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f-kbdvf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3d4f9b87: serviceaccount "payload-processing-e2e-ait-3d4f9b87" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc-mbwcg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3d4f9b87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3d4f9b87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3d4f9b87: serviceaccount "payload-processing-e2e-ait-3d4f9b87" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc-mbwcg

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf-cwgxz

openshift-ingress

multus

payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf-cwgxz

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc-mbwcg

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc-mbwcg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc-mbwcg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf-cwgxz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf-cwgxz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf-cwgxz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-935bafe7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-935bafe7-fdd4b6f47 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-935bafe7-fdd4b6f47

FailedCreate

Error creating: pods "payload-processing-e2e-ait-935bafe7-fdd4b6f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-935bafe7: serviceaccount "payload-processing-e2e-ait-935bafe7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-935bafe7-fdd4b6f47

SuccessfulCreate

Created pod: payload-processing-e2e-ait-935bafe7-fdd4b6f47-tfh7l
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-935bafe7-57c8cd995f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-935bafe7-57c8cd995f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-935bafe7: serviceaccount "payload-processing-e2e-ait-935bafe7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-935bafe7-57c8cd995f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-935bafe7-57c8cd995f-ch8kn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-935bafe7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-935bafe7-57c8cd995f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-935bafe7-fdd4b6f47-tfh7l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-935bafe7-fdd4b6f47-tfh7l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-935bafe7-fdd4b6f47-tfh7l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-935bafe7-fdd4b6f47-tfh7l

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-935bafe7-57c8cd995f-ch8kn

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-935bafe7-57c8cd995f-ch8kn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-935bafe7-57c8cd995f-ch8kn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-935bafe7-57c8cd995f-ch8kn

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-60c85e15

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-60c85e15-749d76b855

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-60c85e15-749d76b855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-60c85e15: serviceaccount "payload-processing-e2e-migrate-60c85e15" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-60c85e15

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-60c85e15-749d76b855 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-60c85e15: serviceaccount "payload-processing-e2e-migrate-60c85e15" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f-zr5g5

openshift-ingress

multus

payload-processing-e2e-migrate-60c85e15-749d76b855-zk9ml

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f-zr5g5

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f-zr5g5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f-zr5g5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f-zr5g5

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-60c85e15-749d76b855

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-60c85e15-749d76b855-zk9ml

openshift-ingress

kubelet

payload-processing-e2e-migrate-60c85e15-749d76b855-zk9ml

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-60c85e15-749d76b855-zk9ml

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.7s (2.7s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-60c85e15-749d76b855-zk9ml

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-60c85e15-749d76b855-zk9ml

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-20f0d1b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-20f0d1b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-20f0d1b6-668d67955c-mhqqt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-20f0d1b6-69485ccfd7-gsgsp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3d4f9b87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-935bafe7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-935bafe7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3d4f9b87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-20f0d1b6-openshift-default-567d5c7dc-g7s24

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-26fbc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-26fbc4
(x5)

openshift-ingress

kubelet

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-26fbc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-26fbc4-755d5d844f from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-26fbc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-pbrf4

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-pbrf4

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-26fbc4: serviceaccount "payload-processing-e2e-worker-w0-26fbc4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-26fbc4-755d5d844f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-26fbc4-755d5d844f-4mvrj
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-26fbc4-755d5d844f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-26fbc4-755d5d844f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-26fbc4: serviceaccount "payload-processing-e2e-worker-w0-26fbc4" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-26fbc4-755d5d844f-4mvrj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-26fbc4-755d5d844f-4mvrj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-pbrf4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-pbrf4

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-26fbc4-755d5d844f-4mvrj

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-pbrf4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-26fbc4-755d5d844f-4mvrj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-60c85e15-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-60c85e15-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-79f7219a-58dcf45b9f-kbdvf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-79f7219a-5ffd85f9-gp4cv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3d4f9b87-7cd6c545bc-mbwcg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3d4f9b87-6b6bb67cdf-cwgxz

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-79f7219a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-79f7219a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-935bafe7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3d4f9b87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3d4f9b87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-935bafe7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-935bafe7-57c8cd995f-ch8kn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-935bafe7-fdd4b6f47-tfh7l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-3d4f9b87-openshift-default-5f49cdfcb7-st68v

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-acd385

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-acd385
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-acd385

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-acd385: serviceaccount "payload-processing-e2e-worker-w4-acd385" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-acd385

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-acd385-855d746459 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-acd385-855d746459

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-acd385-855d746459-22n57
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-acd385-855d746459

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-acd385-855d746459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-acd385: serviceaccount "payload-processing-e2e-worker-w4-acd385" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-2k7jz

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-acd385-855d746459-22n57

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-60c85e15-749d76b855-zk9ml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-acd385-855d746459-22n57

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-2k7jz

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-2k7jz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-2k7jz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-60c85e15-7f4f757c9f-zr5g5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-acd385-855d746459-22n57

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-2k7jz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w4-acd385-855d746459-22n57

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-60c85e15-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-60c85e15-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 0 to 1

openshift-ingress

kubelet

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-97b317

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-97b317

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-e621db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-e621db

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

Created

Container created

openshift-ingress

kubelet

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-79f7219a-openshift-default-d9947f8b9-qsvvk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-935bafe7-openshift-default-59686589bf-67tkq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-e621db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-e621db-68d4bc4bc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e621db-68d4bc4bc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-e621db-68d4bc4bc5-hrkvn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e621db-55897f959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-e621db-55897f959-crnct
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e621db-68d4bc4bc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-e621db-68d4bc4bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e621db: serviceaccount "payload-processing-e2e-worker-w2-e621db" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e621db-55897f959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-e621db-55897f959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e621db: serviceaccount "payload-processing-e2e-worker-w2-e621db" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-e621db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-e621db-55897f959 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e621db-68d4bc4bc5-hrkvn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-e621db-68d4bc4bc5-hrkvn

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e621db-68d4bc4bc5-hrkvn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-e621db-55897f959-crnct

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e621db-55897f959-crnct

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e621db-68d4bc4bc5-hrkvn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e621db-55897f959-crnct

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e621db-55897f959-crnct

Created

Container created

openshift-ingress

kubelet

e2e-migrate-60c85e15-gw-openshift-default-dd595cc5c-kgrgf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 1 to 4

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

Created

Container created

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-ec695b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-ec695b
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-97b317

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-97b317-7878778ccf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-97b317-7878778ccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-97b317-7878778ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-97b317: serviceaccount "payload-processing-e2e-worker-w1-97b317" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-97b317-d84d9dc99

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-97b317-d84d9dc99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-97b317: serviceaccount "payload-processing-e2e-worker-w1-97b317" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-97b317-d84d9dc99

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-97b317-d84d9dc99-5qs45

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-97b317

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-97b317-d84d9dc99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-97b317-7878778ccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-97b317-7878778ccf-9fc6g

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-97b317-7878778ccf-9fc6g

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-97b317-7878778ccf-9fc6g

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-97b317-d84d9dc99-5qs45

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-97b317-d84d9dc99-5qs45

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-97b317-d84d9dc99-5qs45

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-97b317-7878778ccf-9fc6g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-97b317-7878778ccf-9fc6g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-97b317-d84d9dc99-5qs45

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-ec695b-c894f84b9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-ec695b-c894f84b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-ec695b: serviceaccount "payload-processing-e2e-worker-w3-ec695b" not found
(x5)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-ec695b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-ec695b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-ec695b-c894f84b9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-ec695b: serviceaccount "payload-processing-e2e-worker-w3-ec695b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-ec695b-c894f84b9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-ec695b-c894f84b9-jxm6h

openshift-ingress

multus

payload-processing-e2e-worker-w3-ec695b-c894f84b9-jxm6h

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-mz9ck

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-mz9ck

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-mz9ck

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-ec695b-c894f84b9-jxm6h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-ec695b-c894f84b9-jxm6h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-mz9ck

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-mz9ck

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-ec695b-c894f84b9-jxm6h

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

Created

Container created

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": read tcp 10.133.0.2:46712->10.133.0.58:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": read tcp 10.133.0.2:46712->10.133.0.58:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-r6vw8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-r6vw8

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 1 to 2

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

Started

Container started

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 3 to 4

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

Created

Container created

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x7)

models-as-a-service

replicaset-controller

payload-processing-external-model-7fb874b485

FailedCreate

Error creating: pods "payload-processing-external-model-7fb874b485-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7fb874b485 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-7fb874b485-9dxqg

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7fb874b485-9dxqg

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-7fb874b485

SuccessfulCreate

Created pod: payload-processing-external-model-7fb874b485-9dxqg

models-as-a-service

kubelet

payload-processing-external-model-7fb874b485-9dxqg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7fb874b485-9dxqg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-sxrp7

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fc8c56547-sxrp7
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fc8c56547 from 3 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-sxrp7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-sxrp7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-sxrp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-79f6ffb7fd

SuccessfulCreate

Created pod: payload-processing-external-model-79f6ffb7fd-svtt6

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-79f6ffb7fd from 0 to 1

models-as-a-service

multus

payload-processing-external-model-79f6ffb7fd-svtt6

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-79f6ffb7fd-svtt6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-79f6ffb7fd-svtt6

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-79f6ffb7fd-svtt6

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-sxrp7

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-sxrp7

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fc8c56547-79dvv

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fc8c56547-zzqhf

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fc8c56547 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fc8c56547-xgs9d

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fc8c56547-g7nhb

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-79dvv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-79dvv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-79dvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-79dvv

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-zzqhf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-zzqhf

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-g7nhb

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-xgs9d

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-zzqhf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-zzqhf

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-zzqhf

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-zzqhf

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-79dvv

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-79dvv

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

Created

Container created

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fc8c56547 from 8 to 9

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-gbwwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-gbwwl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-gbwwl

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-gbwwl

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-gbwwl

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-gbwwl

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x3)

models-as-a-service

kubelet

payload-processing-external-model-7fb874b485-9dxqg

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-79935e0896e1" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-79f6ffb7fd from 1 to 0
(x6)

models-as-a-service

kubelet

payload-processing-external-model-79f6ffb7fd-svtt6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

multus

payload-processing-external-model-7cb69c85f-fjhzf

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-7cb69c85f

SuccessfulCreate

Created pod: payload-processing-external-model-7cb69c85f-fjhzf

models-as-a-service

kubelet

payload-processing-external-model-79f6ffb7fd-svtt6

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-79f6ffb7fd

SuccessfulDelete

Deleted pod: payload-processing-external-model-79f6ffb7fd-svtt6

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-fjhzf

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-fjhzf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-fjhzf

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fc8c56547 from 9 to 10
(x2)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-fc8c56547-w2k74

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-fc8c56547-w2k74

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 5 to 8

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x5)

models-as-a-service

kubelet

payload-processing-external-model-7fb874b485-9dxqg

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-84267ab48818" not found

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 6 to 9

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

Created

Container created

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7cb69c85f from 1 to 0
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-fjhzf

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-7cb69c85f

SuccessfulDelete

Deleted pod: payload-processing-external-model-7cb69c85f-fjhzf

models-as-a-service

replicaset-controller

payload-processing-external-model-79d4cb79bf

SuccessfulCreate

Created pod: payload-processing-external-model-79d4cb79bf-2zf4s
(x9)

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-fjhzf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-79d4cb79bf from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-79d4cb79bf-2zf4s

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-79d4cb79bf-2zf4s

Created

Container created

models-as-a-service

multus

payload-processing-external-model-79d4cb79bf-2zf4s

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-79d4cb79bf-2zf4s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7fb874b485-9dxqg

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7fb874b485 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-7fb874b485

SuccessfulDelete

Deleted pod: payload-processing-external-model-7fb874b485-9dxqg

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulCreate

Created pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 8 to 10

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7cb69c85f from 0 to 1

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

Created

Container created

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-7cb69c85f

SuccessfulCreate

Created pod: payload-processing-external-model-7cb69c85f-shtfn

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 9 to 10

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

openshift-ingress

multus

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

Created

Container created

models-as-a-service

multus

payload-processing-external-model-7cb69c85f-shtfn

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-shtfn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-shtfn

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-shtfn

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-79d4cb79bf-2zf4s

Killing

Stopping container payload-processing
(x3)

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-shtfn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-7cb69c85f-shtfn

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 4 to 7

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

Unhealthy

Readiness probe failed: Get "https://10.133.0.39:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

Unhealthy

Liveness probe failed: Get "https://10.133.0.39:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

ProbeError

Readiness probe error: Get "http://10.132.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

Unhealthy

Readiness probe failed: Get "http://10.132.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

Unhealthy

Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

ProbeError

Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 5 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9

Started

Container started

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 4 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

Unhealthy

Liveness probe failed: Get "https://10.133.0.39:8000/health": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7fskf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-55xq7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-f259852e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f259852e

openshift-ingress

replicaset-controller

e2e-mt-f259852e-openshift-default-74d46457c

SuccessfulCreate

Created pod: e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pxxph

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-mt-f259852e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f259852e-openshift-default-74d46457c from 0 to 1

openshift-ingress

multus

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f259852e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f259852e-57b4666f87 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f259852e-d98c8f67f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f259852e-d98c8f67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f259852e: serviceaccount "payload-processing-e2e-mt-f259852e" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f259852e-57b4666f87

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f259852e-57b4666f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f259852e: serviceaccount "payload-processing-e2e-mt-f259852e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f259852e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f259852e-d98c8f67f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f259852e-d98c8f67f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f259852e-d98c8f67f-txkrm

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f259852e-57b4666f87

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f259852e-57b4666f87-rwvnm

openshift-ingress

multus

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-txkrm

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-txkrm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-f259852e-57b4666f87-rwvnm

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-f259852e-57b4666f87-rwvnm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-f259852e-57b4666f87-rwvnm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-f259852e-57b4666f87-rwvnm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-txkrm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-txkrm

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

Unhealthy

Readiness probe failed: Get "http://10.132.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

ProbeError

Readiness probe error: Get "http://10.132.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5q9mq

Unhealthy

Readiness probe failed: Get "https://10.133.0.39:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-api-a-4bcda6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4bcda6

openshift-ingress

deployment-controller

e2e-api-a-4bcda6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4bcda6-openshift-default-6b65cf7545 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-4bcda6-openshift-default-6b65cf7545

SuccessfulCreate

Created pod: e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

openshift-ingress

multus

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4bcda6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4bcda6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4bcda6-64d5569cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4bcda6-64d5569cf

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4bcda6-64d5569cf-mjvdg
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4bcda6-64d5569cf

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4bcda6-64d5569cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4bcda6: serviceaccount "payload-processing-e2e-api-a-4bcda6" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4bcda6: serviceaccount "payload-processing-e2e-api-a-4bcda6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f-9jbmm

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f-9jbmm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-4bcda6-64d5569cf-mjvdg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-4bcda6-64d5569cf-mjvdg

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-4bcda6-64d5569cf-mjvdg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-4bcda6-64d5569cf-mjvdg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f-9jbmm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f-9jbmm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f-9jbmm

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 2 to 4

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f259852e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f259852e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-vhmdw

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vhmdw

Created

Container created

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-vhmdw

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vhmdw

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vhmdw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vhmdw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vhmdw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f259852e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f259852e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 4 to 8
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulCreate

Created pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

ProbeError

Readiness probe error: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

Started

Container started

openshift-ingress

kubelet

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

Unhealthy

Readiness probe failed: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

Started

Container started

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4bcda6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4bcda6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-a-f57e85

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f57e85

openshift-ingress

replicaset-controller

e2e-api-a-f57e85-openshift-default-748d65db89

SuccessfulCreate

Created pod: e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd

openshift-ingress

deployment-controller

e2e-api-a-f57e85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f57e85-openshift-default-748d65db89 from 0 to 1

openshift-ingress

multus

e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-3f72e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3f72e4-openshift-default-574694fd57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-3f72e4-openshift-default-574694fd57

SuccessfulCreate

Created pod: e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

openshift-ingress

gateway_labeler_controller

e2e-api-b-3f72e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-3f72e4

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f57e85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f57e85-578955bf55 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f57e85-578955bf55

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f57e85-578955bf55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f57e85: serviceaccount "payload-processing-e2e-api-a-f57e85" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f57e85-589c46599

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f57e85-589c46599-f7427
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f57e85-589c46599

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f57e85-589c46599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f57e85: serviceaccount "payload-processing-e2e-api-a-f57e85" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f57e85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f57e85-589c46599 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f57e85-578955bf55

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f57e85-578955bf55-4wf7g

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f57e85-589c46599-f7427

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-f57e85-578955bf55-4wf7g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f57e85-589c46599-f7427

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f57e85-589c46599-f7427

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f57e85-578955bf55-4wf7g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-f57e85-578955bf55-4wf7g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f57e85-589c46599-f7427

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-f57e85-578955bf55-4wf7g

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4bcda6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4bcda6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3f72e4-7889d697c5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-3f72e4-7889d697c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3f72e4: serviceaccount "payload-processing-e2e-api-b-3f72e4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-3f72e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-3f72e4-7889d697c5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3f72e4: serviceaccount "payload-processing-e2e-api-b-3f72e4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-3f72e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3f72e4-7889d697c5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-3f72e4-7889d697c5-wshr9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc-4knvr

openshift-ingress

multus

payload-processing-e2e-api-b-3f72e4-7889d697c5-wshr9

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-3f72e4-7889d697c5-wshr9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc-4knvr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc-4knvr

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc-4knvr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-3f72e4-7889d697c5-wshr9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-3f72e4-7889d697c5-wshr9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc-4knvr

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3f72e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3f72e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-api-a-88d9b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-88d9b8-openshift-default-7d595b8b79 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-88d9b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-88d9b8

openshift-ingress

replicaset-controller

e2e-api-a-88d9b8-openshift-default-7d595b8b79

SuccessfulCreate

Created pod: e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

openshift-ingress

multus

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-88d9b8-7ff746ff97

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-88d9b8-7ff746ff97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-88d9b8: serviceaccount "payload-processing-e2e-api-a-88d9b8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-88d9b8-7ff746ff97

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-88d9b8-7ff746ff97-nf6tc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f-skts5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-88d9b8: serviceaccount "payload-processing-e2e-api-a-88d9b8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-88d9b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-88d9b8-7ff746ff97 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-88d9b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f-skts5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f-skts5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f-skts5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f-skts5

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-88d9b8-7ff746ff97-nf6tc

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-88d9b8-7ff746ff97-nf6tc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-88d9b8-7ff746ff97-nf6tc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-88d9b8-7ff746ff97-nf6tc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd

Created

Container created

opendatahub

multus

test-curl-7918-2eb58d

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd

Started

Container started

opendatahub

kubelet

test-curl-7918-2eb58d

Created

Container created

opendatahub

kubelet

test-curl-7918-2eb58d

Started

Container started

opendatahub

kubelet

test-curl-7918-2eb58d

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 837ms (837ms including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7918-2eb58d

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x5)

openshift-ingress

kubelet

e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-a-02c8fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-02c8fd-openshift-default-5b4875c4d7 from 0 to 1

openshift-ingress

multus

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-02c8fd-openshift-default-5b4875c4d7

SuccessfulCreate

Created pod: e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

openshift-ingress

gateway_labeler_controller

e2e-api-a-02c8fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-02c8fd

opendatahub

kubelet

test-curl-7918-2eb58d

Killing

Stopping container test-curl-7918-2eb58d

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

Unhealthy

Readiness probe failed: Get "http://10.132.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

ProbeError

Readiness probe error: Get "http://10.132.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-02c8fd: serviceaccount "payload-processing-e2e-api-a-02c8fd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-02c8fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-02c8fd-77c5488457

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-02c8fd-77c5488457-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-02c8fd: serviceaccount "payload-processing-e2e-api-a-02c8fd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-02c8fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-02c8fd-77c5488457 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f57e85-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f57e85-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9-jqz9v

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9-jqz9v

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9-jqz9v

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-02c8fd-77c5488457

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-02c8fd-77c5488457-l9xvx

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9-jqz9v

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-02c8fd-77c5488457-l9xvx

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9-jqz9v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-02c8fd-77c5488457-l9xvx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-02c8fd-77c5488457-l9xvx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-02c8fd-77c5488457-l9xvx

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-txkrm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f259852e-57b4666f87-rwvnm

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f57e85-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f57e85-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-api-b-987f2f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-987f2f-openshift-default-58d767c64c from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-987f2f-openshift-default-58d767c64c

SuccessfulCreate

Created pod: e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6

openshift-ingress

gateway_labeler_controller

e2e-api-b-987f2f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-987f2f
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3f72e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3f72e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-txkrm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-f259852e-57b4666f87-rwvnm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-987f2f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-987f2f-648c6d7d59 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-987f2f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-987f2f-869dbf49 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-987f2f-869dbf49

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-987f2f-869dbf49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-987f2f: serviceaccount "payload-processing-e2e-api-b-987f2f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-987f2f-869dbf49

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-987f2f-869dbf49-t5zdp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-987f2f-648c6d7d59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-n7f8l
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-987f2f-648c6d7d59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-987f2f: serviceaccount "payload-processing-e2e-api-b-987f2f" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-n7f8l

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-n7f8l

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-987f2f-869dbf49-t5zdp

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-987f2f-869dbf49-t5zdp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-987f2f-869dbf49-t5zdp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-987f2f-869dbf49-t5zdp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-n7f8l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-n7f8l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-4bcda6-64d5569cf-mjvdg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4bcda6-69fb89bf7f-9jbmm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulDelete

Deleted pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulDelete

Deleted pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 10 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulDelete

Deleted pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulDelete

Deleted pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulDelete

Deleted pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-nzctm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-svbbl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-88d9b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-88d9b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-5c8cv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-s2jv6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4pc9r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

ProbeError

Readiness probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

Unhealthy

Readiness probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

Created

Container created

openshift-ingress

deployment-controller

e2e-api-b-d6b8ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d6b8ff-openshift-default-748848d8b7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-d6b8ff-openshift-default-748848d8b7

SuccessfulCreate

Created pod: e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht
(x2)

openshift-ingress

kubelet

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-d6b8ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d6b8ff
(x2)

openshift-ingress

kubelet

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

openshift-ingress

multus

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulDelete

Deleted pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 10 to 8

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 5 to 4

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-gd27p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-jppk5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-88d9b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-88d9b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-kcghg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5-w5p9s
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d6b8ff-58745646fc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d6b8ff-58745646fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d6b8ff: serviceaccount "payload-processing-e2e-api-b-d6b8ff" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d6b8ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d6b8ff-58745646fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d6b8ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d6b8ff: serviceaccount "payload-processing-e2e-api-b-d6b8ff" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5-w5p9s

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5-w5p9s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d6b8ff-58745646fc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d6b8ff-58745646fc-2mxhx

openshift-ingress

multus

payload-processing-e2e-api-b-d6b8ff-58745646fc-2mxhx

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6b8ff-58745646fc-2mxhx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6b8ff-58745646fc-2mxhx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5-w5p9s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6b8ff-58745646fc-2mxhx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5-w5p9s

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-02c8fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-02c8fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-sjjcd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-fb4bz

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-prgx2

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8jh2s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 10 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-xkf7f

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 8 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-7hkrn

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulDelete

Deleted pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulDelete

Deleted pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulDelete

Deleted pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulDelete

Deleted pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-qfvmv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-jz4l7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g7whc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-xfgv7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-bc4n6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-vwtvn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

ProbeError

Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-c6bh7

Unhealthy

Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-02c8fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-02c8fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-br6xn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 6 to 4

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulDelete

Deleted pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulDelete

Deleted pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-p68zv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-srmqm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-7870b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7870b4

openshift-ingress

deployment-controller

e2e-api-b-7870b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7870b4-openshift-default-6cbc565675 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-7870b4-openshift-default-6cbc565675

SuccessfulCreate

Created pod: e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f259852e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f259852e-57b4666f87 from 0 to 1

openshift-ingress

multus

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f259852e-57b4666f87

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f259852e-57b4666f87-fr5w2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f259852e-d98c8f67f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f259852e-d98c8f67f-f8mwt
(x5)

openshift-ingress

kubelet

e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f259852e-57b4666f87

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f259852e-57b4666f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f259852e: serviceaccount "payload-processing-e2e-mt-f259852e" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-987f2f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-987f2f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f259852e-d98c8f67f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f259852e-d98c8f67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f259852e: serviceaccount "payload-processing-e2e-mt-f259852e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f259852e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f259852e-d98c8f67f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-f259852e-57b4666f87-fr5w2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-f259852e-57b4666f87-fr5w2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-f8mwt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-f259852e-57b4666f87-fr5w2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-f259852e-57b4666f87-fr5w2

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-f8mwt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-f8mwt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-f8mwt

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7870b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7870b4-7567f9cd47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7870b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7870b4-5597b7945c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7870b4-5597b7945c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7870b4-5597b7945c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7870b4: serviceaccount "payload-processing-e2e-api-b-7870b4" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7870b4-7567f9cd47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7870b4-7567f9cd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7870b4: serviceaccount "payload-processing-e2e-api-b-7870b4" not found

openshift-ingress

multus

payload-processing-e2e-api-b-7870b4-5597b7945c-tj6cw

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7870b4-5597b7945c-tj6cw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7870b4-7567f9cd47-rxsg7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7870b4-7567f9cd47-rxsg7

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7870b4-7567f9cd47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7870b4-7567f9cd47-rxsg7

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7870b4-5597b7945c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7870b4-5597b7945c-tj6cw

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7870b4-7567f9cd47-rxsg7

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7870b4-7567f9cd47-rxsg7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-7870b4-5597b7945c-tj6cw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-7870b4-5597b7945c-tj6cw

Started

Container started

openshift-ingress

kubelet

e2e-api-a-4bcda6-openshift-default-6b65cf7545-j9rhb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-987f2f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-987f2f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-b-3f72e4-7889d697c5-wshr9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3f72e4-6bf758d9dc-4knvr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f57e85-589c46599-f7427

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f57e85-578955bf55-4wf7g

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 8 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

Unhealthy

Readiness probe failed: Get "http://10.132.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

ProbeError

Readiness probe error: Get "http://10.132.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-8ml8f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-xbmg9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7dww4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7870b4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7870b4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

Unhealthy

Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

ProbeError

Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d6b8ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88d9b8-85fbdf445f-skts5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-88d9b8-7ff746ff97-nf6tc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d6b8ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-7vjfc

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7918-f3eb51

Started

Container started

opendatahub

multus

test-curl-7918-f3eb51

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7918-f3eb51

Created

Container created

opendatahub

kubelet

test-curl-7918-f3eb51

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7870b4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7918-f3eb51

Killing

Stopping container test-curl-7918-f3eb51
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7870b4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d6b8ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d6b8ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-lkgg9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulDelete

Deleted pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 4 to 3

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulDelete

Deleted pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-sv6mp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-hvtw6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-mt-f259852e-57b4666f87-fr5w2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f259852e-d98c8f67f-f8mwt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-6rt8b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-a-02c8fd-77c5488457-l9xvx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-02c8fd-7d469c9c9-jqz9v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-3f72e4-openshift-default-574694fd57-hqf49

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-f57e85-openshift-default-748d65db89-5wlsd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-g7nhb

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-fc8c56547 from 10 to 7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-xgs9d

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-w2k74

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-n7f8l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-88d9b8-openshift-default-7d595b8b79-ttb98

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-987f2f-869dbf49-t5zdp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-g7nhb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-w2k74

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-xgs9d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-987f2f-869dbf49-t5zdp

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.92:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-987f2f-648c6d7d59-n7f8l

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.91:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-sxrp7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-sxrp7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-fc8c56547 from 7 to 6

openshift-ingress

kubelet

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-f259852e-openshift-default-74d46457c-lhkcq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-sxrp7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-sxrp7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6b8ff-58745646fc-2mxhx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6b8ff-6d497b75f5-w5p9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-02c8fd-openshift-default-5b4875c4d7-4r55r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7870b4-7567f9cd47-rxsg7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7870b4-5597b7945c-tj6cw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-987f2f-openshift-default-58d767c64c-qh8k6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9

SuccessfulCreate

Created pod: e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f5b0cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f5b0cb

openshift-ingress

deployment-controller

e2e-ipp-a-f5b0cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulDelete

Deleted pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-xjd56

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f5b0cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f5b0cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf-7ghg8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f5b0cb: serviceaccount "payload-processing-e2e-ipp-a-f5b0cb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f-fg5nl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f5b0cb: serviceaccount "payload-processing-e2e-ipp-a-f5b0cb" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f-fg5nl

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f-fg5nl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f-fg5nl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f-fg5nl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf-7ghg8

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf-7ghg8

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf-7ghg8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf-7ghg8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc

SuccessfulCreate

Created pod: e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

openshift-ingress

deployment-controller

e2e-ipp-a-7cfab8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7cfab8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7cfab8

openshift-ingress

multus

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7cfab8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7cfab8: serviceaccount "payload-processing-e2e-ipp-a-7cfab8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc-5wvsj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7cfab8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7cfab8: serviceaccount "payload-processing-e2e-ipp-a-7cfab8" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc-5wvsj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf-mqshj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf-mqshj

openshift-ingress

multus

payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc-5wvsj

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc-5wvsj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc-5wvsj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf-mqshj

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf-mqshj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf-mqshj

Created

Container created

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b95dca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b95dca

openshift-ingress

kubelet

e2e-api-b-d6b8ff-openshift-default-748848d8b7-sjfht

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-b95dca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b95dca-openshift-default-79dd955555 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-b95dca-openshift-default-79dd955555

SuccessfulCreate

Created pod: e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-kzqfp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-prs8n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b95dca: serviceaccount "payload-processing-e2e-ipp-a-b95dca" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b95dca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b95dca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b95dca-f77b8dc7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b95dca-f77b8dc7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b95dca-f77b8dc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b95dca: serviceaccount "payload-processing-e2e-ipp-a-b95dca" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5-9cm2r

openshift-ingress

multus

payload-processing-e2e-ipp-a-b95dca-f77b8dc7-qh7nx

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b95dca-f77b8dc7-qh7nx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5-9cm2r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b95dca-f77b8dc7-qh7nx

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b95dca-f77b8dc7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b95dca-f77b8dc7-qh7nx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5-9cm2r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5-9cm2r

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5-9cm2r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b95dca-f77b8dc7-qh7nx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulDelete

Deleted pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-lwz66

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-7870b4-openshift-default-6cbc565675-8bcb2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b95dca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b95dca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c9da8f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c9da8f

openshift-ingress

replicaset-controller

e2e-ipp-a-c9da8f-openshift-default-b878c8997

SuccessfulCreate

Created pod: e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

openshift-ingress

deployment-controller

e2e-ipp-a-c9da8f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c9da8f-openshift-default-b878c8997 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vhmdw

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-vhmdw
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f5b0cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f5b0cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-9bgk9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-79dvv

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-zzqhf

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-fc8c56547 from 6 to 4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-zzqhf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-79dvv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-zzqhf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-zzqhf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c9da8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-79dvv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-79dvv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5-brxdq
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9da8f: serviceaccount "payload-processing-e2e-ipp-a-c9da8f" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9da8f: serviceaccount "payload-processing-e2e-ipp-a-c9da8f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779-s5mpf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c9da8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779-s5mpf

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779-s5mpf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5-brxdq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5-brxdq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5-brxdq

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5-brxdq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779-s5mpf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779-s5mpf

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

ProbeError

Readiness probe error: Get "http://10.132.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

Unhealthy

Readiness probe failed: Get "http://10.132.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-676f48879f-fg5nl

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f5b0cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f5b0cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f5b0cb-66f79c8dbf-7ghg8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-6c7db9-openshift-default-69bd847677

SuccessfulCreate

Created pod: e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

openshift-ingress

deployment-controller

e2e-ipp-a-6c7db9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6c7db9-openshift-default-69bd847677 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6c7db9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6c7db9
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7cfab8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7cfab8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79-r9s4r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6c7db9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6c7db9: serviceaccount "payload-processing-e2e-ipp-a-6c7db9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6c7db9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6c7db9-5645df674c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6c7db9-5645df674c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6c7db9-5645df674c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6c7db9: serviceaccount "payload-processing-e2e-ipp-a-6c7db9" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c7db9-5645df674c-lc7b4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-6c7db9-5645df674c-lc7b4

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79-r9s4r

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6c7db9-5645df674c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6c7db9-5645df674c-lc7b4

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c7db9-5645df674c-lc7b4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c7db9-5645df674c-lc7b4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79-r9s4r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79-r9s4r

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79-r9s4r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-ipp-b-0ea963-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0ea963-openshift-default-f86f4c75c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0ea963

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0ea963

openshift-ingress

replicaset-controller

e2e-ipp-b-0ea963-openshift-default-f86f4c75c

SuccessfulCreate

Created pod: e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll

openshift-ingress

multus

e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7cfab8-5d54c6d6bc-5wvsj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7cfab8-84f8977bcf-mqshj

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7cfab8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7cfab8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ea963-999665dc5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0ea963-999665dc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ea963: serviceaccount "payload-processing-e2e-ipp-b-0ea963" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0ea963

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579-n46z9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ea963: serviceaccount "payload-processing-e2e-ipp-b-0ea963" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0ea963

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0ea963-999665dc5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579-n46z9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ea963-999665dc5-772kv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579-n46z9

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

ProbeError

Readiness probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ea963-999665dc5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0ea963-999665dc5-772kv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579-n46z9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-pqz7m

Unhealthy

Readiness probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579-n46z9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b95dca-f77b8dc7-qh7nx

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-0ea963-999665dc5-772kv

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b95dca-fdf779bf5-9cm2r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ea963-999665dc5-772kv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ea963-999665dc5-772kv

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c0359f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c0359f

openshift-ingress

deployment-controller

e2e-ipp-b-c0359f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c0359f-openshift-default-6467bc78bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-c0359f-openshift-default-6467bc78bf

SuccessfulCreate

Created pod: e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt

openshift-ingress

multus

e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f5b0cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f5b0cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f5b0cb: serviceaccount "payload-processing-e2e-ipp-a-f5b0cb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f5b0cb: serviceaccount "payload-processing-e2e-ipp-a-f5b0cb" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-pdv8p

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-pdv8p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-pdv8p

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.831s (1.831s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-pdv8p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-pdv8p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-pdv8p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.14s (2.14s including waiting). Image size: 166620835 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b95dca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b95dca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c0359f-786c8479

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c0359f-786c8479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c0359f: serviceaccount "payload-processing-e2e-ipp-b-c0359f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c0359f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c0359f-786c8479 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c0359f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7cfab8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c0359f: serviceaccount "payload-processing-e2e-ipp-b-c0359f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-82zx2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-c0359f-786c8479-t5j58

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c0359f-786c8479

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c0359f-786c8479-t5j58

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7cfab8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-82zx2

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c0359f-786c8479-t5j58

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7cfab8: serviceaccount "payload-processing-e2e-ipp-a-7cfab8" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7cfab8: serviceaccount "payload-processing-e2e-ipp-a-7cfab8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-82zx2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-82zx2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-82zx2

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75-fvj9r

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c0359f-786c8479-t5j58

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c0359f-786c8479-t5j58

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75-fvj9r

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-634135-openshift-default-7f7b88d49

SuccessfulCreate

Created pod: e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8

openshift-ingress

deployment-controller

e2e-ipp-b-634135-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-634135-openshift-default-7f7b88d49 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75-fvj9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd-62dmm

openshift-ingress

multus

payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd-62dmm

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75-fvj9r

Created

Container created

openshift-ingress

multus

e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75-fvj9r

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-634135

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-634135

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd-62dmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd-62dmm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd-62dmm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-634135

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-634135-6c54f6fdbc from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

Unhealthy

Startup probe failed: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-634135-6c54f6fdbc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-634135-6c54f6fdbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-634135: serviceaccount "payload-processing-e2e-ipp-b-634135" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-634135-8cd476b87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-634135-8cd476b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-634135: serviceaccount "payload-processing-e2e-ipp-b-634135" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-634135-8cd476b87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-634135-8cd476b87-s6c5k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-634135

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-634135-8cd476b87 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

ProbeError

Startup probe error: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-634135-6c54f6fdbc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-634135-6c54f6fdbc-nkpz4

openshift-ingress

multus

payload-processing-e2e-ipp-b-634135-6c54f6fdbc-nkpz4

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-634135-8cd476b87-s6c5k

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-634135-6c54f6fdbc-nkpz4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-634135-8cd476b87-s6c5k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-634135-6c54f6fdbc-nkpz4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-634135-8cd476b87-s6c5k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-634135-8cd476b87-s6c5k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-634135-6c54f6fdbc-nkpz4

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c9da8f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c9da8f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b95dca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b95dca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b95dca: serviceaccount "payload-processing-e2e-ipp-a-b95dca" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b95dca: serviceaccount "payload-processing-e2e-ipp-a-b95dca" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9-7bvnz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9-7bvnz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9-7bvnz

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9-7bvnz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6-p4jqd

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6-p4jqd

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6-p4jqd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6-p4jqd

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6-p4jqd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9-7bvnz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6c7db9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6c7db9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c9da8f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c9da8f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9da8f-6b9976b9c5-brxdq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9da8f-78f759f779-s5mpf

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6c7db9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6c7db9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-b-a31828-openshift-default-675c75fbc5

SuccessfulCreate

Created pod: e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9

openshift-ingress

deployment-controller

e2e-ipp-b-a31828-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a31828-openshift-default-675c75fbc5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a31828

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a31828

openshift-ingress

multus

e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a31828-5d7786d855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a31828: serviceaccount "payload-processing-e2e-ipp-b-a31828" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a31828

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a31828-5d7786d855 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a31828-7c64bcbb89

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a31828-7c64bcbb89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a31828: serviceaccount "payload-processing-e2e-ipp-b-a31828" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a31828

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a31828-7c64bcbb89 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-a31828-7c64bcbb89-nn7fb

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-ctlqq

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a31828-5d7786d855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-ctlqq

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-ctlqq

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a31828-7c64bcbb89

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a31828-7c64bcbb89-nn7fb

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-ctlqq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-ctlqq

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a31828-7c64bcbb89-nn7fb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a31828-7c64bcbb89-nn7fb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a31828-7c64bcbb89-nn7fb

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0ea963-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0ea963-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-3f0818

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-3f0818

openshift-ingress

replicaset-controller

e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc

SuccessfulCreate

Created pod: e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp

openshift-ingress

deployment-controller

e2e-ipp-b-3f0818-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt

Created

Container created

openshift-ingress

multus

e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c0359f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c0359f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c7db9-5645df674c-lc7b4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c7db9-5cf9d6bf79-r9s4r

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0ea963-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0ea963-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-9ngbl
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-fc8c56547 from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-9ngbl

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-9ngbl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-9ngbl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-3f0818

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-3f0818

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-3f0818-55fdff8547 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5-qmpq4

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3f0818-55fdff8547

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-3f0818-55fdff8547-jpvnj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5-qmpq4
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3f0818: serviceaccount "payload-processing-e2e-ipp-b-3f0818" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3f0818-55fdff8547

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-3f0818-55fdff8547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3f0818: serviceaccount "payload-processing-e2e-ipp-b-3f0818" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5-qmpq4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5-qmpq4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f0818-55fdff8547-jpvnj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f0818-55fdff8547-jpvnj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5-qmpq4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-3f0818-55fdff8547-jpvnj

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f0818-55fdff8547-jpvnj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ea963-999665dc5-772kv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ea963-5f55d44579-n46z9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c9da8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45

SuccessfulDelete

Deleted pod: e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-qqstz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-acd385-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c9da8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c9da8f-67bb794556 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-acd385-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-acd385-openshift-default-6f6f9f6f45 from 2 to 1
(x5)

openshift-ingress

kubelet

e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9da8f: serviceaccount "payload-processing-e2e-ipp-a-c9da8f" not found
(x5)

openshift-ingress

kubelet

e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9da8f-67bb794556

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c9da8f-67bb794556-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9da8f: serviceaccount "payload-processing-e2e-ipp-a-c9da8f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9da8f-67bb794556

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c9da8f-67bb794556-gpdnf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467-lzj7k

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467-lzj7k

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467-lzj7k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467-lzj7k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467-lzj7k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9da8f-67bb794556-gpdnf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-c9da8f-67bb794556-gpdnf

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9da8f-67bb794556-gpdnf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9da8f-67bb794556-gpdnf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-634135-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-634135-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c0359f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c0359f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c0359f-786c8479-t5j58

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-82zx2

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-634135-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-634135-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c0359f-7f8cfd7687-82zx2

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.102:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6c7db9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6c7db9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6c7db9-84d975d5bd from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6c7db9-84d975d5bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6c7db9-84d975d5bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6c7db9: serviceaccount "payload-processing-e2e-ipp-a-6c7db9" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6c7db9: serviceaccount "payload-processing-e2e-ipp-a-6c7db9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c-7whk5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c-7whk5

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c-7whk5

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6c7db9-84d975d5bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6c7db9-84d975d5bd-r8479

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c-7whk5

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c-7whk5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c7db9-84d975d5bd-r8479

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c7db9-84d975d5bd-r8479

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c7db9-84d975d5bd-r8479

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-6c7db9-84d975d5bd-r8479

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-634135-6c54f6fdbc-nkpz4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-634135-8cd476b87-s6c5k

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-7g4sd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

ProbeError

Readiness probe error: Get "http://10.133.0.82:15021/healthz/ready": read tcp 10.133.0.2:41504->10.133.0.82:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-nvq4r

Unhealthy

Readiness probe failed: Get "http://10.133.0.82:15021/healthz/ready": read tcp 10.133.0.2:41504->10.133.0.82:15021: read: connection reset by peer

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b95dca-7f4f7b97d6-p4jqd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b95dca-7c9488d9f9-7bvnz

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0ea963

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0ea963-59b8874fcb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0ea963

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ea963: serviceaccount "payload-processing-e2e-ipp-b-0ea963" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ea963-59b8874fcb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0ea963-59b8874fcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ea963: serviceaccount "payload-processing-e2e-ipp-b-0ea963" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-vzg9x

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-vzg9x

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a31828-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-vzg9x

Created

Container created
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-ec695b-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-ec695b-openshift-default-5d78d64df9 from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a31828-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-ec695b-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-ec695b-openshift-default-5d78d64df9

SuccessfulDelete

Deleted pod: e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-vzg9x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ea963-59b8874fcb-65mvw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-0ea963-59b8874fcb-65mvw

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ea963-59b8874fcb-65mvw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-vzg9x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ea963-59b8874fcb-65mvw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ea963-59b8874fcb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0ea963-59b8874fcb-65mvw

openshift-ingress

kubelet

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-c8xns

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-b95dca-openshift-default-79dd955555-n8895

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-vzg9x

Unhealthy

Readiness probe failed: dial tcp 10.132.0.163:9004: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a31828-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a31828-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-6xjn4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-6xjn4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-fc8c56547 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-6xjn4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-6xjn4
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3f0818-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3f0818-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp

Unhealthy

Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp

ProbeError

Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-26fbc4-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-26fbc4-openshift-default-7cf9949555

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-26fbc4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-26fbc4-openshift-default-7cf9949555 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-qgknz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-c0359f-openshift-default-6467bc78bf-hs5tt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-ctlqq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a31828-7c64bcbb89-nn7fb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a31828-5d7786d855-ctlqq

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.108:50052" within 1s: context deadline exceeded

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-6a9710

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-6a9710

openshift-ingress

deployment-controller

e2e-praxis-a-6a9710-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-6a9710-openshift-default-784c585d5 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-6a9710-openshift-default-784c585d5

SuccessfulCreate

Created pod: e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-634135

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-634135-56686b8fcb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-634135

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-634135-56686b8fcb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-634135-56686b8fcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-634135: serviceaccount "payload-processing-e2e-ipp-b-634135" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-634135: serviceaccount "payload-processing-e2e-ipp-b-634135" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff-t6898

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff-t6898

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff-t6898

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-634135-56686b8fcb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-634135-56686b8fcb-crwc4

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-634135-56686b8fcb-crwc4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff-t6898

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3f0818-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-ipp-b-634135-56686b8fcb-crwc4

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-634135-56686b8fcb-crwc4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-634135-56686b8fcb-crwc4

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3f0818-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff-t6898

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6a9710: serviceaccount "payload-processing-e2e-praxis-a-6a9710" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-6a9710

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-6a9710

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-6a9710-68dc7c4d55 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6a9710-68dc7c4d55

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-6a9710-68dc7c4d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6a9710: serviceaccount "payload-processing-e2e-praxis-a-6a9710" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7-5p9l8

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a9710-68dc7c4d55-wptrv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-6a9710-68dc7c4d55-wptrv

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a9710-68dc7c4d55-wptrv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a9710-68dc7c4d55-wptrv

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6a9710-68dc7c4d55

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-6a9710-68dc7c4d55-wptrv

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7-5p9l8

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7-5p9l8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7-5p9l8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7-5p9l8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f0818-5c5c6677c5-qmpq4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f0818-55fdff8547-jpvnj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f5b0cb-7ffc75dd54-pdv8p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f5b0cb-66d85b9547-vznjr

Unhealthy

Readiness probe failed: dial tcp 10.134.0.129:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-f5b0cb-openshift-default-6fd5b4d5f9-jb9pz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a31828

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a31828

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a31828: serviceaccount "payload-processing-e2e-ipp-b-a31828" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a31828: serviceaccount "payload-processing-e2e-ipp-b-a31828" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf-xhjnp

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf-xhjnp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf-xhjnp

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf-xhjnp

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6-xzmzn

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf-xhjnp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6-xzmzn

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6-xzmzn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6-xzmzn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7cfab8-69fb96d8dd-62dmm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7cfab8-7f47847b75-fvj9r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6-xzmzn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c7db9-84d975d5bd-r8479

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c7db9-75cb587d8c-7whk5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-7cfab8-openshift-default-58c86bbfcc-ts5wh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-6c7db9-openshift-default-69bd847677-f6slv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-3f0818

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-3f0818

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-3f0818-679c745975 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3f0818: serviceaccount "payload-processing-e2e-ipp-b-3f0818" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3f0818-679c745975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-3f0818-679c745975-jvkr7
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3f0818-679c745975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-3f0818-679c745975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3f0818: serviceaccount "payload-processing-e2e-ipp-b-3f0818" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f0818-679c745975-jvkr7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f0818-679c745975-jvkr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-3f0818-679c745975-jvkr7

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb-28gh9
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f0818-679c745975-jvkr7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ea963-59b8874fcb-65mvw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb-28gh9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb-28gh9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb-28gh9

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ea963-767ff78d7f-vzg9x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb-28gh9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a9710-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a9710-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-0ea963-openshift-default-f86f4c75c-rjhll

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a9710-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a9710-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-634135-68bd5b84ff-t6898

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-634135-56686b8fcb-crwc4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-634135-openshift-default-7f7b88d49-xc6n8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-25b9ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-25b9ff

openshift-ingress

deployment-controller

e2e-praxis-a-25b9ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-25b9ff-openshift-default-6765cd78b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-25b9ff-openshift-default-6765cd78b5

SuccessfulCreate

Created pod: e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7

openshift-ingress

multus

e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-66100b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-66100b-openshift-default-5d4fbcccb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-66100b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-66100b

openshift-ingress

replicaset-controller

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5

SuccessfulCreate

Created pod: e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

openshift-ingress

multus

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-25b9ff-6866c4fdff

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-25b9ff: serviceaccount "payload-processing-e2e-praxis-a-25b9ff" not found

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-d867bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-d867bb

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-25b9ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-25b9ff-6866c4fdff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-25b9ff-6866c4fdff

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-jrgkf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-25b9ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-hh4nk

openshift-ingress

deployment-controller

e2e-praxis-b-d867bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-d867bb-openshift-default-794ffc9585 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-d867bb-openshift-default-794ffc9585

SuccessfulCreate

Created pod: e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-25b9ff: serviceaccount "payload-processing-e2e-praxis-a-25b9ff" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-hh4nk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-jrgkf

Started

Container started

openshift-ingress

multus

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-jrgkf

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-hh4nk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-hh4nk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-jrgkf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-hh4nk

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-jrgkf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f0818-5b7cbd75fb-28gh9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f0818-679c745975-jvkr7

Unhealthy

Readiness probe failed: dial tcp 10.132.0.170:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f0818-679c745975-jvkr7

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d867bb: serviceaccount "payload-processing-e2e-praxis-b-d867bb" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d867bb-5d86c66f99

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-d867bb-5d86c66f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d867bb: serviceaccount "payload-processing-e2e-praxis-b-d867bb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-d867bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-d867bb-5d86c66f99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d867bb-5d86c66f99

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-d867bb-5d86c66f99-7zbt9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-d867bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675-hd65w

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675-hd65w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675-hd65w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d867bb-5d86c66f99-7zbt9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-d867bb-5d86c66f99-7zbt9

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675-hd65w

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675-hd65w

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d867bb-5d86c66f99-7zbt9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d867bb-5d86c66f99-7zbt9

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-3f0818-openshift-default-5b5b7bfbcc-25dfp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-66100b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-66100b-855b664dd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79-kbxkf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-66100b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-0c0723

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-0c0723
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-66100b: serviceaccount "payload-processing-e2e-praxis-a-66100b" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-66100b-855b664dd9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-66100b-855b664dd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-66100b: serviceaccount "payload-processing-e2e-praxis-a-66100b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-66100b-855b664dd9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-66100b-855b664dd9-ljdvj

openshift-ingress

multus

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79-kbxkf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-a-0c0723-openshift-default-5d695ccfc

SuccessfulCreate

Created pod: e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79-kbxkf

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-a-0c0723-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-0c0723-openshift-default-5d695ccfc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79-kbxkf

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-66100b-855b664dd9-ljdvj

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-66100b-855b664dd9-ljdvj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79-kbxkf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-66100b-855b664dd9-ljdvj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-66100b-855b664dd9-ljdvj

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-0c0723

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-0c0723-757b66d6df from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-0c0723: serviceaccount "payload-processing-e2e-praxis-a-0c0723" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-0c0723-757b66d6df

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-0c0723-757b66d6df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-0c0723: serviceaccount "payload-processing-e2e-praxis-a-0c0723" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-0c0723

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659-ndnnd

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659-ndnnd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0c0723-757b66d6df-tb7m9

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-0c0723-757b66d6df

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-0c0723-757b66d6df-tb7m9

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659-ndnnd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0c0723-757b66d6df-tb7m9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0c0723-757b66d6df-tb7m9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659-ndnnd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-0c0723-757b66d6df-tb7m9

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659-ndnnd

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d867bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d867bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9da8f-5cf46b4467-lzj7k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9da8f-67bb794556-gpdnf

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-25b9ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-25b9ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7

Unhealthy

Startup probe failed: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7

ProbeError

Startup probe error: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

ProbeError

Readiness probe error: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

Unhealthy

Readiness probe failed: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-25b9ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-25b9ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-c9da8f-openshift-default-b878c8997-52db5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d867bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d867bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fc8c56547

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fc8c56547-tgg84

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fc8c56547-tgg84

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-fc8c56547 from 2 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-66100b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-66100b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-praxis-b-ade881-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ade881-openshift-default-6c7c46d945 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-ade881-openshift-default-6c7c46d945

SuccessfulCreate

Created pod: e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ade881

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ade881

openshift-ingress

multus

e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a9710-68dc7c4d55-wptrv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a9710-865f76ddb7-5p9l8

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ade881

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ade881

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ade881-559866dbc9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ade881: serviceaccount "payload-processing-e2e-praxis-b-ade881" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ade881-559866dbc9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ade881-559866dbc9-wck74

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9-xlmdb
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ade881-559866dbc9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ade881-559866dbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ade881: serviceaccount "payload-processing-e2e-praxis-b-ade881" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-ade881-559866dbc9-wck74

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9-xlmdb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9-xlmdb

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-001a26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-001a26-openshift-default-79d9c75c5c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-001a26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-001a26

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a31828-6d8dbcfbb6-xzmzn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ade881-559866dbc9-wck74

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9-xlmdb

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-b-001a26-openshift-default-79d9c75c5c

SuccessfulCreate

Created pod: e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ade881-559866dbc9-wck74

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a31828-84cb5869cf-xhjnp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9-xlmdb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ade881-559866dbc9-wck74

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-66100b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-66100b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c-mjj4v

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-001a26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-001a26-67b644b4f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-001a26-67b644b4f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-001a26-67b644b4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-001a26: serviceaccount "payload-processing-e2e-praxis-b-001a26" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-001a26-67b644b4f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-001a26-67b644b4f-l8bms
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-001a26: serviceaccount "payload-processing-e2e-praxis-b-001a26" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-001a26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c-mjj4v

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-001a26-67b644b4f-l8bms

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c-mjj4v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c-mjj4v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c-mjj4v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-001a26-67b644b4f-l8bms

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-001a26-67b644b4f-l8bms

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-001a26-67b644b4f-l8bms

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-6a9710-openshift-default-784c585d5-bjjfm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

ProbeError

Startup probe error: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

Unhealthy

Startup probe failed: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-76aba6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-76aba6

openshift-ingress

replicaset-controller

e2e-praxis-b-76aba6-openshift-default-55446c9749

SuccessfulCreate

Created pod: e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh

openshift-ingress

multus

e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-76aba6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-76aba6-openshift-default-55446c9749 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-a31828-openshift-default-675c75fbc5-tbrs9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d867bb-68c8c75675-hd65w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d867bb-5d86c66f99-7zbt9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0c0723-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0c0723-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767-nm2vs
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-76aba6: serviceaccount "payload-processing-e2e-praxis-b-76aba6" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-76aba6-64bcd7599f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-76aba6-64bcd7599f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-76aba6: serviceaccount "payload-processing-e2e-praxis-b-76aba6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-76aba6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-76aba6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-76aba6-64bcd7599f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-76aba6-64bcd7599f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-76aba6-64bcd7599f-r42lj

openshift-ingress

multus

payload-processing-e2e-praxis-b-76aba6-64bcd7599f-r42lj

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767-nm2vs

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767-nm2vs

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767-nm2vs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-76aba6-64bcd7599f-r42lj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767-nm2vs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-76aba6-64bcd7599f-r42lj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-76aba6-64bcd7599f-r42lj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-001a26-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-001a26-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-d867bb-openshift-default-794ffc9585-5tvsn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0c0723-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0c0723-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml

ProbeError

Startup probe error: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml

Unhealthy

Startup probe failed: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 1 to 2
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

Unhealthy

Startup probe failed: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

ProbeError

Startup probe error: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ade881-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ade881-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh

Unhealthy

Startup probe failed: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh

ProbeError

Startup probe error: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-76aba6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-76aba6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-001a26-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-001a26-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-76aba6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-76aba6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-66100b-855b664dd9-ljdvj

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-66100b-7489ddbc79-kbxkf

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

ProbeError

Startup probe error: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

Unhealthy

Startup probe failed: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0c0723-7b8d4659-ndnnd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0c0723-757b66d6df-tb7m9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

Unhealthy

Startup probe failed: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

ProbeError

Startup probe error: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

Unhealthy

Startup probe failed: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

ProbeError

Startup probe error: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 4 to 5

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

Unhealthy

Startup probe failed: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

ProbeError

Startup probe error: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-66100b-openshift-default-5d4fbcccb5-kvgdx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-001a26-5b46fbfd6c-mjj4v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-001a26-67b644b4f-l8bms

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-0c0723-openshift-default-5d695ccfc-q996b

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

Unhealthy

Startup probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

ProbeError

Startup probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-001a26-openshift-default-79d9c75c5c-5r7pr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-76aba6-64bcd7599f-r42lj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-76aba6-7b67c58767-nm2vs

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulCreate

Created pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

(combined from similar events): New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-41014a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-41014a

openshift-ingress

replicaset-controller

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5

SuccessfulCreate

Created pod: e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

openshift-ingress

deployment-controller

e2e-shared-a-w1-41014a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-41014a-openshift-default-8586c99cf5 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2

Unhealthy

Startup probe failed: Get "http://10.132.0.195:15021/healthz/ready": dial tcp 10.132.0.195:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2

ProbeError

Startup probe error: Get "http://10.132.0.195:15021/healthz/ready": dial tcp 10.132.0.195:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-b992fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-b992fe

openshift-ingress

replicaset-controller

e2e-shared-a-w3-b992fe-openshift-default-58cf56d755

SuccessfulCreate

Created pod: e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw

openshift-ingress

deployment-controller

e2e-shared-a-w3-b992fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-b992fe-openshift-default-58cf56d755 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-41014a: serviceaccount "payload-processing-e2e-shared-a-w1-41014a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-41014a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-41014a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-41014a: serviceaccount "payload-processing-e2e-shared-a-w1-41014a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-r89bd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-2pw7f

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-r89bd

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-2pw7f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-r89bd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-r89bd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-2pw7f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-r89bd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-2pw7f

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-2pw7f

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b992fe: serviceaccount "payload-processing-e2e-shared-a-w3-b992fe" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-b992fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b992fe: serviceaccount "payload-processing-e2e-shared-a-w3-b992fe" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-b992fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-jj44t

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-mgw65

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-mgw65

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-jj44t

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-jj44t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-mgw65

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-jj44t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-jj44t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-mgw65

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-mgw65

AddedInterface

Add eth0 [10.132.0.198/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx

Unhealthy

Startup probe failed: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx

ProbeError

Startup probe error: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-a-w2-dc9e63-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-dc9e63

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-dc9e63

openshift-ingress

replicaset-controller

e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9

SuccessfulCreate

Created pod: e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z

openshift-ingress

multus

e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

Unhealthy

Startup probe failed: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

ProbeError

Startup probe error: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-76aba6-openshift-default-55446c9749-bv9rh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-dc9e63

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-dc9e63: serviceaccount "payload-processing-e2e-shared-a-w2-dc9e63" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-dc9e63: serviceaccount "payload-processing-e2e-shared-a-w2-dc9e63" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-dc9e63

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-hbf2d

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-hbf2d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-7g4gj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-hbf2d

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-7g4gj

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-hbf2d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-7g4gj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-7g4gj

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-7g4gj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-hbf2d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulCreate

Created pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-jrgkf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-hh4nk

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn

ProbeError

Startup probe error: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn

Unhealthy

Startup probe failed: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-25b9ff-54d8df4b8c-hh4nk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-25b9ff-6866c4fdff-jrgkf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

ProbeError

Readiness probe error: Get "http://10.132.0.196:15021/healthz/ready": read tcp 10.132.0.2:34654->10.132.0.196:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

Unhealthy

Readiness probe failed: Get "http://10.132.0.196:15021/healthz/ready": read tcp 10.132.0.2:34654->10.132.0.196:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw

ProbeError

Startup probe error: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw

Unhealthy

Startup probe failed: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

Unhealthy

Startup probe failed: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

ProbeError

Startup probe error: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-41014a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-41014a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-b6f24b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-b6f24b

openshift-ingress

deployment-controller

e2e-shared-a-w4-b6f24b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695

SuccessfulCreate

Created pod: e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

openshift-ingress

multus

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w1-083e17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-083e17-openshift-default-b69b5b55f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-083e17

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-083e17

openshift-ingress

replicaset-controller

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f

SuccessfulCreate

Created pod: e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

openshift-ingress

multus

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-9grfz
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-b6f24b: serviceaccount "payload-processing-e2e-shared-a-w4-b6f24b" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-b6f24b: serviceaccount "payload-processing-e2e-shared-a-w4-b6f24b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-zcbtp

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-b6f24b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-b6f24b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-9grfz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-zcbtp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-9grfz

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-41014a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-41014a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-9grfz

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-zcbtp

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-zcbtp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-9grfz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-zcbtp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-083e17

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-083e17: serviceaccount "payload-processing-e2e-shared-b-w1-083e17" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-083e17

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-jstb5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-083e17: serviceaccount "payload-processing-e2e-shared-b-w1-083e17" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-zxrm2

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-zxrm2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-jstb5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-jstb5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-jstb5

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-zxrm2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-zxrm2

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-zxrm2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-jstb5

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z

ProbeError

Startup probe error: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z

Unhealthy

Startup probe failed: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w3-7fc058-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-7fc058-openshift-default-7f85564869 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-7fc058

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-7fc058

openshift-ingress

replicaset-controller

e2e-shared-b-w3-7fc058-openshift-default-7f85564869

SuccessfulCreate

Created pod: e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm

openshift-ingress

multus

e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-8lmh6
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-dc9e63-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7fc058: serviceaccount "payload-processing-e2e-shared-b-w3-7fc058" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-n5j7l

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-7fc058

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7fc058: serviceaccount "payload-processing-e2e-shared-b-w3-7fc058" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-dc9e63-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-7fc058

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-n5j7l

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-8lmh6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-n5j7l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-b992fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-n5j7l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-n5j7l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-8lmh6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-8lmh6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-8lmh6

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-b992fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-b6f24b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-b6f24b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-dc9e63-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-dc9e63-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-9c9c3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-9c9c3c

openshift-ingress

deployment-controller

e2e-shared-b-w2-9c9c3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7

SuccessfulCreate

Created pod: e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt

openshift-ingress

multus

e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-7fc058-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-7fc058-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-9c9c3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-nwj76
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-9c9c3c: serviceaccount "payload-processing-e2e-shared-b-w2-9c9c3c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-pbrqh
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-9c9c3c: serviceaccount "payload-processing-e2e-shared-b-w2-9c9c3c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-9c9c3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-pbrqh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-pbrqh

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-pbrqh

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-pbrqh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-nwj76

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-nwj76

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-nwj76

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-nwj76

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-25b9ff-openshift-default-6765cd78b5-tsfw7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ade881-54f84d99c9-xlmdb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ade881-559866dbc9-wck74

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

Unhealthy

Readiness probe failed: Get "http://10.134.0.204:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

ProbeError

Readiness probe error: Get "http://10.134.0.204:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-083e17-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-083e17-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

Unhealthy

Startup probe failed: Get "http://10.134.0.204:15021/healthz/ready": dial tcp 10.134.0.204:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

ProbeError

Startup probe error: Get "http://10.134.0.204:15021/healthz/ready": dial tcp 10.134.0.204:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

Unhealthy

Startup probe failed: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

ProbeError

Startup probe error: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-083e17-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-083e17-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm

ProbeError

Startup probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm

Unhealthy

Startup probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-95404c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-95404c

openshift-ingress

deployment-controller

e2e-shared-b-w4-95404c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-95404c-openshift-default-d65bc58dc from 0 to 1

openshift-ingress

multus

e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w4-95404c-openshift-default-d65bc58dc

SuccessfulCreate

Created pod: e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-b6f24b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-b6f24b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-ade881-openshift-default-6c7c46d945-7dmml

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-95404c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-95404c-768484d899 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-95404c-768484d899

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-95404c: serviceaccount "payload-processing-e2e-shared-b-w4-95404c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-95404c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-95404c: serviceaccount "payload-processing-e2e-shared-b-w4-95404c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-58ktl

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-58ktl

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-95404c-768484d899

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-q5wdq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-q5wdq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-58ktl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-58ktl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-q5wdq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-q5wdq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-q5wdq

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-58ktl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-explicit-c12708

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c12708
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-9c9c3c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-9c9c3c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-explicit-c12708-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c12708-openshift-default-64449fc95c from 0 to 1

openshift-ingress

multus

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-c12708-openshift-default-64449fc95c

SuccessfulCreate

Created pod: e2e-explicit-c12708-openshift-default-64449fc95c-lv54p
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-7fc058-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-7fc058-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c12708

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c12708-6b559dfb79 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c12708

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c12708-857bb95bf9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c12708-857bb95bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c12708-857bb95bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c12708: serviceaccount "payload-processing-e2e-explicit-c12708" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c12708-6b559dfb79

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c12708-6b559dfb79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c12708: serviceaccount "payload-processing-e2e-explicit-c12708" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c12708-857bb95bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c12708-857bb95bf9-nv9tg

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c12708-857bb95bf9-nv9tg

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c12708-6b559dfb79

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c12708-6b559dfb79-cllsf

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c12708-857bb95bf9-nv9tg

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c12708-857bb95bf9-nv9tg

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c12708-857bb95bf9-nv9tg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-c12708-6b559dfb79-cllsf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-explicit-c12708-6b559dfb79-cllsf

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-c12708-6b559dfb79-cllsf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-c12708-6b559dfb79-cllsf

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-9c9c3c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-9c9c3c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-hlpsl

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-77jm2

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-8f54x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-95404c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-95404c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6

Unhealthy

Startup probe failed: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6

ProbeError

Startup probe error: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-n5gqc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-qbpkx

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-wxlmn
(x2)

openshift-ingress

kubelet

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-g4rvn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

ProbeError

Startup probe error: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

Unhealthy

Startup probe failed: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-95404c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-95404c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c12708-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c12708-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-ztrzh

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c12708-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c12708-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c12708-857bb95bf9-nv9tg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c12708-6b559dfb79-cllsf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c12708-857bb95bf9-nv9tg

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.209:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-d39811

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-d39811

openshift-ingress

deployment-controller

e2e-noten-d39811-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-d39811-openshift-default-6898949c8f from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-d39811-openshift-default-6898949c8f

SuccessfulCreate

Created pod: e2e-noten-d39811-openshift-default-6898949c8f-pl68h

openshift-ingress

kubelet

e2e-noten-d39811-openshift-default-6898949c8f-pl68h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-d39811-openshift-default-6898949c8f-pl68h

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-d39811-openshift-default-6898949c8f-pl68h

Created

Container created

openshift-ingress

kubelet

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-d39811-openshift-default-6898949c8f-pl68h

Started

Container started

openshift-ingress

kubelet

e2e-explicit-c12708-openshift-default-64449fc95c-lv54p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 4 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

Killing

Stopping container istio-proxy
(x9)

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 5 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-dx49w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-ws6tw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-tq9zf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

openshift-ingress

replicaset-controller

e2e-worker-w1-97b317-openshift-default-747d7dd9df

SuccessfulDelete

Deleted pod: e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-97b317-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x7)

openshift-ingress

deployment-controller

e2e-worker-w1-97b317-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-97b317-openshift-default-747d7dd9df from 3 to 1

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-9b6fw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-cv8th

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-d39811-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-d39811-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-d39811-openshift-default-6898949c8f-pl68h

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7909-76f1c5

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 3 to 2

opendatahub

kubelet

test-curl-7909-76f1c5

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

replicaset-controller

e2e-worker-w2-e621db-openshift-default-5c44f894cc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-sznq2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-7909-76f1c5

Started

Container started

opendatahub

kubelet

test-curl-7909-76f1c5

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 7.041s (7.041s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7909-76f1c5

Created

Container created

opendatahub

kubelet

test-curl-7909-9cb945

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7909-9cb945

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7909-76f1c5

Killing

Stopping container test-curl-7909-76f1c5

opendatahub

kubelet

test-curl-7909-9cb945

Created

Container created

opendatahub

kubelet

test-curl-7909-9cb945

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.502s (2.502s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7909-9cb945

Started

Container started

opendatahub

kubelet

test-curl-7906-a0e3ce

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7906-a0e3ce

Started

Container started

opendatahub

kubelet

test-curl-7906-a0e3ce

Created

Container created

opendatahub

multus

test-curl-7906-a0e3ce

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e621db-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-e621db-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e621db-openshift-default-5c44f894cc from 2 to 1

opendatahub

kubelet

test-curl-7906-a0e3ce

Killing

Stopping container test-curl-7906-a0e3ce

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-7fmsd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-extmod-a-864622-openshift-default-58df9f7d7c

SuccessfulCreate

Created pod: e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

openshift-ingress

deployment-controller

e2e-extmod-a-864622-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-864622-openshift-default-58df9f7d7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-864622

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-864622

openshift-ingress

multus

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-864622: serviceaccount "payload-processing-e2e-extmod-a-864622" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-864622-6df6b698c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-864622-6df6b698c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-864622: serviceaccount "payload-processing-e2e-extmod-a-864622" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-864622

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-864622-6df6b698c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-864622

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c-fr5ck

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-864622-6df6b698c-kfxl4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-864622-6df6b698c-kfxl4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-864622-6df6b698c-kfxl4

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c-fr5ck

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-864622-6df6b698c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-864622-6df6b698c-kfxl4

openshift-ingress

multus

payload-processing-e2e-extmod-a-864622-6df6b698c-kfxl4

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c-fr5ck

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c-fr5ck

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c-fr5ck

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-6c6990-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6c6990-openshift-default-d954b8c5c from 0 to 1

openshift-ingress

multus

e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-6c6990

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-6c6990

openshift-ingress

replicaset-controller

e2e-extmod-a-6c6990-openshift-default-d954b8c5c

SuccessfulCreate

Created pod: e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn

opendatahub

kubelet

test-curl-7909-9cb945

Killing

Stopping container test-curl-7909-9cb945

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-6caf19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-6caf19

openshift-ingress

deployment-controller

e2e-extmod-a-6caf19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6caf19-openshift-default-66c887d577 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-6caf19-openshift-default-66c887d577

SuccessfulCreate

Created pod: e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-6c6990

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-6c6990-6666c66857 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-6c6990

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-a-6c6990-6666c66857-9z5gw

AddedInterface

Add eth0 [10.134.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5-rfthr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6c6990-6666c66857

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-6c6990-6666c66857-9z5gw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5-rfthr
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6c6990: serviceaccount "payload-processing-e2e-extmod-a-6c6990" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5-rfthr

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6c6990-6666c66857

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-6c6990-6666c66857-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6c6990: serviceaccount "payload-processing-e2e-extmod-a-6c6990" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5-rfthr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5-rfthr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6c6990-6666c66857-9z5gw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6c6990-6666c66857-9z5gw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6c6990-6666c66857-9z5gw

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-6caf19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-6caf19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-6caf19-7567445fcf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6caf19-7567445fcf

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-6caf19-7567445fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6caf19: serviceaccount "payload-processing-e2e-extmod-a-6caf19" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7-lrhfr
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6caf19: serviceaccount "payload-processing-e2e-extmod-a-6caf19" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6caf19-7567445fcf-5x4fd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7-lrhfr

AddedInterface

Add eth0 [10.134.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7-lrhfr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7-lrhfr

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6caf19-7567445fcf

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-6caf19-7567445fcf-5x4fd

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7-lrhfr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-6caf19-7567445fcf-5x4fd

AddedInterface

Add eth0 [10.134.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6caf19-7567445fcf-5x4fd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6caf19-7567445fcf-5x4fd

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ce8dbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ce8dbb

openshift-ingress

replicaset-controller

e2e-extmod-a-ce8dbb-openshift-default-867c885f77

SuccessfulCreate

Created pod: e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx

openshift-ingress

deployment-controller

e2e-extmod-a-ce8dbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ce8dbb-openshift-default-867c885f77 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ce8dbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ce8dbb: serviceaccount "payload-processing-e2e-extmod-a-ce8dbb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47-6rsdk
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ce8dbb: serviceaccount "payload-processing-e2e-extmod-a-ce8dbb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ce8dbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f-z4997

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f-z4997

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f-z4997

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f-z4997

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47-6rsdk

AddedInterface

Add eth0 [10.134.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47-6rsdk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f-z4997

AddedInterface

Add eth0 [10.134.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47-6rsdk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47-6rsdk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ce8dbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ce8dbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

ProbeError

Readiness probe error: Get "http://10.132.0.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

Unhealthy

Readiness probe failed: Get "http://10.132.0.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

Unhealthy

Startup probe failed: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

ProbeError

Startup probe error: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-864622-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-864622-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7918-d973bf

Started

Container started

opendatahub

kubelet

test-curl-7918-d973bf

Created

Container created

opendatahub

kubelet

test-curl-7918-d973bf

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7918-d973bf

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn

ProbeError

Startup probe error: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn

Unhealthy

Startup probe failed: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused

opendatahub

kubelet

test-curl-7918-d973bf

Killing

Stopping container test-curl-7918-d973bf

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-fbe06f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-fbe06f

openshift-ingress

deployment-controller

e2e-extmod-b-fbe06f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-fbe06f-openshift-default-68589cdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-fbe06f-openshift-default-68589cdf

SuccessfulCreate

Created pod: e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4

openshift-ingress

multus

e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4

AddedInterface

Add eth0 [10.134.0.242/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6c6990-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6c6990-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6caf19-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx

Unhealthy

Startup probe failed: Get "http://10.132.0.223:15021/healthz/ready": dial tcp 10.132.0.223:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6caf19-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx

ProbeError

Startup probe error: Get "http://10.132.0.223:15021/healthz/ready": dial tcp 10.132.0.223:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

ProbeError

Startup probe error: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

Unhealthy

Startup probe failed: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-fbe06f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-fbe06f-97c787bd7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fbe06f-97c787bd7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-fbe06f-97c787bd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fbe06f: serviceaccount "payload-processing-e2e-extmod-b-fbe06f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-fbe06f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fbe06f-97c787bd7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-fbe06f-97c787bd7-5tbv8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9-vwmww
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fbe06f: serviceaccount "payload-processing-e2e-extmod-b-fbe06f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9-vwmww

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9-vwmww

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9-vwmww

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-fbe06f-97c787bd7-5tbv8

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9-vwmww

AddedInterface

Add eth0 [10.134.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fbe06f-97c787bd7-5tbv8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fbe06f-97c787bd7-5tbv8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fbe06f-97c787bd7-5tbv8

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ce8dbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ce8dbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-autores-d50516-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-d50516-openshift-default-db6dbb8c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-d50516-openshift-default-db6dbb8c7

SuccessfulCreate

Created pod: e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw

openshift-ingress

gateway_labeler_controller

e2e-autores-d50516

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-d50516

openshift-ingress

multus

e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw

AddedInterface

Add eth0 [10.134.0.244/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6caf19-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6caf19-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-bbe5e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-bbe5e0-openshift-default-56656f665 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-bbe5e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-bbe5e0

openshift-ingress

replicaset-controller

e2e-extmod-b-bbe5e0-openshift-default-56656f665

SuccessfulCreate

Created pod: e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

openshift-ingress

multus

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

AddedInterface

Add eth0 [10.134.0.245/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-d50516

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-d50516-74646775f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-d50516

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-d50516-bc99c4787 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d50516-bc99c4787

SuccessfulCreate

Created pod: payload-processing-e2e-autores-d50516-bc99c4787-bv9c7
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d50516-74646775f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-d50516-74646775f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d50516: serviceaccount "payload-processing-e2e-autores-d50516" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d50516-bc99c4787

FailedCreate

Error creating: pods "payload-processing-e2e-autores-d50516-bc99c4787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d50516: serviceaccount "payload-processing-e2e-autores-d50516" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-d50516-74646775f-znft5

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d50516-74646775f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-d50516-74646775f-znft5

openshift-ingress

kubelet

payload-processing-e2e-autores-d50516-bc99c4787-bv9c7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d50516-74646775f-znft5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d50516-74646775f-znft5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d50516-74646775f-znft5

Started

Container started

openshift-ingress

multus

payload-processing-e2e-autores-d50516-bc99c4787-bv9c7

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-d50516-bc99c4787-bv9c7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-d50516-bc99c4787-bv9c7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-bbe5e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-bbe5e0-f6448875f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-bbe5e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bbe5e0-f6448875f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-bbe5e0-f6448875f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bbe5e0: serviceaccount "payload-processing-e2e-extmod-b-bbe5e0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bbe5e0-f6448875f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-bbe5e0-f6448875f-b8nfx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bbe5e0: serviceaccount "payload-processing-e2e-extmod-b-bbe5e0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9-z897c

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9-z897c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bbe5e0-f6448875f-b8nfx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bbe5e0-f6448875f-b8nfx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9-z897c

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bbe5e0-f6448875f-b8nfx

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-8a35f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-8a35f7

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9-z897c

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-bbe5e0-f6448875f-b8nfx

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9-z897c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

AddedInterface

Add eth0 [10.132.0.231/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-8a35f7-openshift-default-775b5f679c

SuccessfulCreate

Created pod: e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

openshift-ingress

deployment-controller

e2e-extmod-b-8a35f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-8a35f7-openshift-default-775b5f679c from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bbe5e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bbe5e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-8a35f7: serviceaccount "payload-processing-e2e-extmod-b-8a35f7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-8a35f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-8a35f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-8a35f7-594c6b5865 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-8a35f7-594c6b5865

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-8a35f7-594c6b5865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-8a35f7: serviceaccount "payload-processing-e2e-extmod-b-8a35f7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495-nmrh2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495-nmrh2

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-8a35f7-594c6b5865

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-8a35f7-594c6b5865-mnvjb

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-caff19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-caff19

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495-nmrh2

openshift-ingress

deployment-controller

e2e-extmod-b-caff19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-caff19-openshift-default-859f4f5fd9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495-nmrh2

AddedInterface

Add eth0 [10.134.0.246/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-caff19-openshift-default-859f4f5fd9

SuccessfulCreate

Created pod: e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495-nmrh2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8a35f7-594c6b5865-mnvjb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8a35f7-594c6b5865-mnvjb

Started

Container started

openshift-ingress

multus

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

AddedInterface

Add eth0 [10.134.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8a35f7-594c6b5865-mnvjb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-8a35f7-594c6b5865-mnvjb

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-caff19: serviceaccount "payload-processing-e2e-extmod-b-caff19" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-caff19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-caff19-58756c467c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-caff19-58756c467c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-caff19-58756c467c-mzgnw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf-ndwwr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-caff19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-caff19-58756c467c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-caff19-58756c467c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-caff19: serviceaccount "payload-processing-e2e-extmod-b-caff19" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-caff19-58756c467c-mzgnw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-caff19-58756c467c-mzgnw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-caff19-58756c467c-mzgnw

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf-ndwwr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-caff19-58756c467c-mzgnw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf-ndwwr

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf-ndwwr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf-ndwwr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4

Unhealthy

Startup probe failed: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4

ProbeError

Startup probe error: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fbe06f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fbe06f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

ProbeError

Readiness probe error: Get "http://10.134.0.245:15021/healthz/ready": dial tcp 10.134.0.245:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

Unhealthy

Readiness probe failed: Get "http://10.134.0.245:15021/healthz/ready": dial tcp 10.134.0.245:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

Unhealthy

Startup probe failed: Get "http://10.134.0.245:15021/healthz/ready": dial tcp 10.134.0.245:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

ProbeError

Startup probe error: Get "http://10.134.0.245:15021/healthz/ready": dial tcp 10.134.0.245:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw

Unhealthy

Startup probe failed: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw

ProbeError

Startup probe error: Get "http://10.134.0.244:15021/healthz/ready": dial tcp 10.134.0.244:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-864622-6df6b698c-kfxl4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-864622-7c4c768c8c-fr5ck

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

ProbeError

Readiness probe error: Get "http://10.132.0.231:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

Unhealthy

Readiness probe failed: Get "http://10.132.0.231:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-d50516-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

Created

Container created
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-d50516-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

Unhealthy

Readiness probe failed: Get "http://10.134.0.248:15021/healthz/ready": dial tcp 10.134.0.248:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

ProbeError

Readiness probe error: Get "http://10.134.0.248:15021/healthz/ready": dial tcp 10.134.0.248:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

ProbeError

Startup probe error: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

Unhealthy

Startup probe failed: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bbe5e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bbe5e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

Unhealthy

Startup probe failed: Get "http://10.134.0.248:15021/healthz/ready": dial tcp 10.134.0.248:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

ProbeError

Startup probe error: Get "http://10.134.0.248:15021/healthz/ready": dial tcp 10.134.0.248:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8a35f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8a35f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-caff19-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-caff19-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-autores-d50516-bc99c4787-bv9c7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d50516-74646775f-znft5

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8a35f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8a35f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-caff19-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-caff19-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6c6990-57fcf755c5-rfthr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6c6990-6666c66857-9z5gw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-d50516-openshift-default-db6dbb8c7-6k5kw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6caf19-7567445fcf-5x4fd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6caf19-5cf4b5dfd7-lrhfr

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-extmod-a-a713e6-openshift-default-686545875c

SuccessfulCreate

Created pod: e2e-extmod-a-a713e6-openshift-default-686545875c-59f22

openshift-ingress

deployment-controller

e2e-extmod-a-a713e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-a713e6-openshift-default-686545875c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-a713e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-a713e6

openshift-ingress

multus

e2e-extmod-a-a713e6-openshift-default-686545875c-59f22

AddedInterface

Add eth0 [10.134.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ce8dbb-7445847b47-6rsdk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ce8dbb-64d8f4b55f-z4997

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-864622-openshift-default-58df9f7d7c-q5rkw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-a713e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-a713e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-a713e6-57b7d787df from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5-nl77f

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5-nl77f

AddedInterface

Add eth0 [10.134.1.0/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a713e6: serviceaccount "payload-processing-e2e-extmod-a-a713e6" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a713e6-57b7d787df

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-a713e6-57b7d787df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a713e6: serviceaccount "payload-processing-e2e-extmod-a-a713e6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a713e6-57b7d787df

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-a713e6-57b7d787df-xlrvf

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a713e6-57b7d787df-xlrvf

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-a713e6-57b7d787df-xlrvf

AddedInterface

Add eth0 [10.134.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5-nl77f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5-nl77f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5-nl77f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a713e6-57b7d787df-xlrvf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a713e6-57b7d787df-xlrvf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fbe06f-97c787bd7-5tbv8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fbe06f-689f958cc9-vwmww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-fbe06f-openshift-default-68589cdf-kshv4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-6c6990-openshift-default-d954b8c5c-h9vgn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-pbrf4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-26fbc4-755d5d844f-4mvrj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-6caf19-openshift-default-66c887d577-8m9qw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bbe5e0-f6448875f-b8nfx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bbe5e0-6f9958cbc9-z897c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8a35f7-594c6b5865-mnvjb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8a35f7-7f776c4495-nmrh2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-26fbc4-755d5d844f-4mvrj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-26fbc4-54bcb4bd4c-pbrf4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-ce8dbb-openshift-default-867c885f77-lb8cx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-caff19-7864c8b6cf-ndwwr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-caff19-58756c467c-mzgnw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-8a35f7-openshift-default-775b5f679c-bxpw5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-2pw7f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-r89bd

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a713e6-openshift-default-686545875c-59f22

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a713e6-openshift-default-686545875c-59f22

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a713e6-openshift-default-686545875c-59f22

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-a-a713e6-openshift-default-686545875c-59f22

ProbeError

Startup probe error: Get "http://10.134.0.254:15021/healthz/ready": dial tcp 10.134.0.254:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-a713e6-openshift-default-686545875c-59f22

Unhealthy

Startup probe failed: Get "http://10.134.0.254:15021/healthz/ready": dial tcp 10.134.0.254:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-41014a-5758d9cf7c-r89bd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-41014a-8446845c47-2pw7f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a713e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-bbe5e0-openshift-default-56656f665-6dbzx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a713e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-mgw65

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-jj44t

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-b91499

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-b91499

openshift-ingress

multus

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-b91499-openshift-default-86797fd8d5

SuccessfulCreate

Created pod: e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

openshift-ingress

deployment-controller

e2e-extmod-b-b91499-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-b91499-openshift-default-86797fd8d5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-b91499

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-b91499-697b648765 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b91499: serviceaccount "payload-processing-e2e-extmod-b-b91499" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-b91499

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f-92kzl
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b91499-697b648765

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-b91499-697b648765-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b91499: serviceaccount "payload-processing-e2e-extmod-b-b91499" not found

openshift-ingress

kubelet

e2e-extmod-b-caff19-openshift-default-859f4f5fd9-lnwhs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b91499-697b648765

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-b91499-697b648765-58gq7

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b91499-697b648765-58gq7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b91499-697b648765-58gq7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f-92kzl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f-92kzl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f-92kzl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-b91499-697b648765-58gq7

AddedInterface

Add eth0 [10.134.1.11/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f-92kzl

AddedInterface

Add eth0 [10.134.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b91499-697b648765-58gq7

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b992fe-69564dfbd7-jj44t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b992fe-f7f997f9c-mgw65

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-7g4gj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-hbf2d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-41014a-openshift-default-8586c99cf5-pv5sj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-zxrm2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-jstb5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc9e63-6684fb4989-7g4gj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc9e63-5b787b699f-hbf2d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-b992fe-openshift-default-58cf56d755-9pbbw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-26fbc4-openshift-default-7cf9949555-mlblg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-8lmh6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-n5j7l

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-083e17-766fd46f8c-jstb5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-083e17-58cf7b7b45-zxrm2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-dc9e63-openshift-default-56b64c6fc9-jgk5z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-pbrqh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-nwj76

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7fc058-7d59fcb779-n5j7l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7fc058-86886d6d99-8lmh6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-9c9c3c-openshift-default-54f8bc8bf7-c2dxt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-083e17-openshift-default-b69b5b55f-87778

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9c9c3c-7dd967ff87-pbrqh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9c9c3c-6dd578b7cf-nwj76

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

ProbeError

Startup probe error: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

Unhealthy

Startup probe failed: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e621db-68d4bc4bc5-hrkvn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e621db-55897f959-crnct

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-7fc058-openshift-default-7f85564869-pjsgm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-97b317-d84d9dc99-5qs45

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-97b317-7878778ccf-9fc6g

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b91499-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b91499-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-ec695b-c894f84b9-jxm6h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-mz9ck

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b91499-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b91499-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-ec695b-c894f84b9-jxm6h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-ec695b-6bd569445f-mz9ck

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-97b317-openshift-default-747d7dd9df-m4rsc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-ec695b-openshift-default-5d78d64df9-4x6pz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e621db-openshift-default-5c44f894cc-lz6v5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a713e6-57b7d787df-xlrvf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a713e6-858ff99cc5-nl77f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-a713e6-openshift-default-686545875c-59f22

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b91499-7b94874f5f-92kzl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b91499-697b648765-58gq7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

Unhealthy

Readiness probe failed: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-b91499-openshift-default-86797fd8d5-lct6q

ProbeError

Readiness probe error: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-9grfz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-zcbtp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

ProbeError

Readiness probe error: Get "http://10.134.0.204:15021/healthz/ready": dial tcp 10.134.0.204:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w4-b6f24b-openshift-default-7fbf48f695-nrs4b

Unhealthy

Readiness probe failed: Get "http://10.134.0.204:15021/healthz/ready": dial tcp 10.134.0.204:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b6f24b-6c5b6bc95f-9grfz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b6f24b-6d9fd97cd5-zcbtp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-q5wdq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-58ktl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w4-95404c-openshift-default-d65bc58dc-mw7n6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-95404c-768484d899-q5wdq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-95404c-8589dcf5cc-58ktl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-2k7jz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-acd385-855d746459-22n57

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-acd385-55ccbddc67-2k7jz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-acd385-855d746459-22n57

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-acd385-openshift-default-6f6f9f6f45-4p6zk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503