Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-c257e7-d4df69d7b-5s4bt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c257e7-d4df69d7b-5s4bt to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-4f2325-74f4586c46-k8dqc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4f2325-74f4586c46-k8dqc to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-bdf9e6-7544c775f8-dcjpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-bdf9e6-7544c775f8-dcjpn to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq to ip-10-0-132-214.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-4g2vw

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-4g2vw to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-4f2325-849994d776-qf6ph

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4f2325-849994d776-qf6ph to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-dsbmn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-dsbmn to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-913351-5fdf8855f8-cmg2s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-913351-5fdf8855f8-cmg2s to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-89c124-5694d4b8c4-dlbnw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-89c124-5694d4b8c4-dlbnw to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-d97cc8-758b89656b-k6rxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-d97cc8-758b89656b-k6rxc to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-913351-64c79d9748-wzvj5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-913351-64c79d9748-wzvj5 to ip-10-0-141-42.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-bw5vt

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-bw5vt to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-969878-5fbf8d98cb-l6tkb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-969878-5fbf8d98cb-l6tkb to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-5f9b3c-668c96494b-cg7kb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-5f9b3c-668c96494b-cg7kb to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-cntb6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-cntb6 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-2a2286-866c7dfb84-ktc6t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-2a2286-866c7dfb84-ktc6t to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff-hzg9q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff-hzg9q to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

Scheduled

Successfully assigned openshift-ingress/e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-75fgg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-75fgg to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-8c8241-79657d945b-5gwzv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-8c8241-79657d945b-5gwzv to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-426bab-759c7cdb9b-x2s72

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-426bab-759c7cdb9b-x2s72 to ip-10-0-132-214.us-east-2.compute.internal

kuadrant-system

authorino-5677757b6d-m57tz

Scheduled

Successfully assigned kuadrant-system/authorino-5677757b6d-m57tz to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-vpm56

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-vpm56 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-75b361-5865586895-n8bqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-75b361-5865586895-n8bqc to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-040623-86f6f98d86-5pp5q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-040623-86f6f98d86-5pp5q to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-t5hh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-t5hh5 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595-9xplz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595-9xplz to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-ggxvs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-ggxvs to ip-10-0-142-167.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-59fbh

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-59fbh to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-c9d69c-588d68c4db-d9d4q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c9d69c-588d68c4db-d9d4q to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-68685b-95c569d74-vxj27

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-68685b-95c569d74-vxj27 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-517027-869b54f744-6sn2p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-517027-869b54f744-6sn2p to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2

Scheduled

Successfully assigned openshift-ingress/e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-222480-655cd8df6-rvlwx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-222480-655cd8df6-rvlwx to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-f0e884-b8df455b8-wb58x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f0e884-b8df455b8-wb58x to ip-10-0-132-214.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-mgr5d

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-mgr5d to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-d05eeacd-596f4f9cb6-tkmg2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-d05eeacd-596f4f9cb6-tkmg2 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-836d67-5d8bbbf5b8-x2dzx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-836d67-5d8bbbf5b8-x2dzx to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-f61e4b-66959bc884-hmnz9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f61e4b-66959bc884-hmnz9 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-969878-openshift-default-74f689c897-bzsph to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-6ac47d-7544f97974-s4cp5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-6ac47d-7544f97974-s4cp5 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr to ip-10-0-141-42.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-8fshs

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-8fshs to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-2beb7b-5bbfdfc944-hmv9l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2beb7b-5bbfdfc944-hmv9l to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-2761c7-86c888b596-7b8d5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2761c7-86c888b596-7b8d5 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-e907e4-654594658b-fw8n2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e907e4-654594658b-fw8n2 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-501ac8-768b76884b-8wrfj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-501ac8-768b76884b-8wrfj to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v to ip-10-0-132-214.us-east-2.compute.internal

kuadrant-system

authorino-6dd76875b5-2ws5q

Scheduled

Successfully assigned kuadrant-system/authorino-6dd76875b5-2ws5q to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp to ip-10-0-141-42.us-east-2.compute.internal

kuadrant-system

authorino-84f585c5-n9z4n

Scheduled

Successfully assigned kuadrant-system/authorino-84f585c5-n9z4n to ip-10-0-141-42.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-25jst

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-25jst to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg to ip-10-0-141-42.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-fd8cbc9d9-m5t29

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-fd8cbc9d9-m5t29 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-rs668

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-rs668 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5-mzsbd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5-mzsbd to ip-10-0-132-214.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-gbld7

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-gbld7 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-api-a-e907e4-openshift-default-5565b5d845-799mq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e907e4-openshift-default-5565b5d845-799mq to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-noten-8fdea8-openshift-default-98d979769-skktq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-8fdea8-openshift-default-98d979769-skktq to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9-vj88z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9-vj88z to ip-10-0-141-42.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-mgclc

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-mgclc to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-q8vd4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-q8vd4 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

router-default-787bddbb47-hfcvw

Scheduled

Successfully assigned openshift-ingress/router-default-787bddbb47-hfcvw to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

router-default-787bddbb47-hfcvw

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-787bddbb47-hfcvw

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-sdp74

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-sdp74 to ip-10-0-132-214.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-gmgtn

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-gmgtn to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-w9t9z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-w9t9z to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-f06af6-77784df88-qg6p6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-f06af6-77784df88-qg6p6 to ip-10-0-141-42.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-4ttjv

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-4ttjv to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-1e3723-7664ccccb4-tl8pc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1e3723-7664ccccb4-tl8pc to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-07292b-openshift-default-744696b8d9-pljg8 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-bf7sk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-bf7sk to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f to ip-10-0-132-214.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-jz2dn

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-jz2dn to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-8836a8-7f7565d946-zl9c7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-8836a8-7f7565d946-zl9c7 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-07292b-74459b4d58-g8xfm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-07292b-74459b4d58-g8xfm to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh to ip-10-0-142-167.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-2kq47

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-2kq47 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc to ip-10-0-132-214.us-east-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-6pvgl

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-6pvgl to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-59tph

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-59tph to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-b33c04be-5c89c4c68b-59jpz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b33c04be-5c89c4c68b-59jpz to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-426bab-7c4d75cb74-6v8gn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-426bab-7c4d75cb74-6v8gn to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674-jvq68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674-jvq68 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-bxr9v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-bxr9v to ip-10-0-132-214.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-k5q55

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k5q55 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f-zw8j8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f-zw8j8 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667-94d6v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667-94d6v to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c-ntf8l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c-ntf8l to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f-59v4h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f-59v4h to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-xfbnc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-xfbnc to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc-gkfmx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc-gkfmx to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547-b8s7z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547-b8s7z to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-z7bmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-z7bmj to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-sggp9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-sggp9 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-1d482894-6fc5774b99-msqpt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-1d482894-6fc5774b99-msqpt to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-g74ff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-g74ff to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7-cvnn6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7-cvnn6 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95-82slf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95-82slf to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95-kqkp8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95-kqkp8 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c-m2tkx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c-m2tkx to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc-2vzn5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc-2vzn5 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-040623-6db97689bc-rh2kf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-040623-6db97689bc-rh2kf to ip-10-0-142-167.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-kkzgw

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-kkzgw to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-040623-5f54648f55-hx52g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-040623-5f54648f55-hx52g to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955-lkr9q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955-lkr9q to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9-8v6rk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9-8v6rk to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-pv667

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-pv667 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-913351-5587d6644c-25q64

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-913351-5587d6644c-25q64 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-4f2325-9b997dc-d2jsf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4f2325-9b997dc-d2jsf to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c-k9h2j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c-k9h2j to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-426bab-c67495f5-4mq9r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-426bab-c67495f5-4mq9r to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-426bab-659f447667-7fkg4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-426bab-659f447667-7fkg4 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-55a8e6-5c95d4c796-pzh5w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-55a8e6-5c95d4c796-pzh5w to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-tflt6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-tflt6 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b-b4gww

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b-b4gww to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-7966j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-7966j to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-59e21a-75b5d75c8d-rbx6t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-59e21a-75b5d75c8d-rbx6t to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-wrctx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-wrctx to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-59e21a-7b48b6cc86-8r4tc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-59e21a-7b48b6cc86-8r4tc to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-8rlnl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-8rlnl to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-6d8p4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-6d8p4 to ip-10-0-132-214.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-6jh27

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-6jh27 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-z8lw8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-z8lw8 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-969878-686cb65c47-6gjpm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-969878-686cb65c47-6gjpm to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b-5h64l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b-5h64l to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-hwx2w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-hwx2w to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff-swzth

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff-swzth to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-040623-577cc456d-sf9nq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-040623-577cc456d-sf9nq to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-twp4p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-twp4p to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-vc4fk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-vc4fk to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c-cbhc7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c-cbhc7 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-9845b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-9845b to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-gjlbp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-gjlbp to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b-p4gs4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b-p4gs4 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-4npjj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-4npjj to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-517027-587c5945f5-qgfvs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-517027-587c5945f5-qgfvs to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-222480-65976658b7-m2tql

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-222480-65976658b7-m2tql to ip-10-0-132-214.us-east-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-jt9lh

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-jt9lh to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f0e884-9f9499899-rlbsw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f0e884-9f9499899-rlbsw to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7-lmrkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7-lmrkw to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-ccgjb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-ccgjb to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-836d67-665d67575f-2mpk8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-836d67-665d67575f-2mpk8 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5-gv9x9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5-gv9x9 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-6ac47d-7b459856ff-w6ttx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-6ac47d-7b459856ff-w6ttx to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479-5cpxb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479-5cpxb to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2761c7-776cb78fff-k5tqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2761c7-776cb78fff-k5tqc to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e907e4-64d884bb9f-2cp6w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e907e4-64d884bb9f-2cp6w to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c-bnggs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c-bnggs to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1e3723-5b496fc79f-r2slx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1e3723-5b496fc79f-r2slx to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5-m67zk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5-m67zk to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-b33c04be-59455ff787-47bln

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b33c04be-59455ff787-47bln to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-3a55af38-65c8454759-5gbpz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3a55af38-65c8454759-5gbpz to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-4x62h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-4x62h to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-2j4r6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-2j4r6 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg to ip-10-0-141-42.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8zcm5m

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8zcm5m to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-3a55af38-6f454d75c4-s62sm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3a55af38-6f454d75c4-s62sm to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6c786f9b57kmt86

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57kmt86 to ip-10-0-132-214.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-78f5b8588d-p5vzw to ip-10-0-141-42.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-78f5b8588d-hthgg

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-78f5b8588d-hthgg to ip-10-0-142-167.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-78f5b8588d-9gfr5 to ip-10-0-132-214.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-89xm5

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-89xm5 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-7454465567-q9n4s

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-7454465567-q9n4s to ip-10-0-132-214.us-east-2.compute.internal

opendatahub

maas-controller-5cf964748-d8zhr

Scheduled

Successfully assigned opendatahub/maas-controller-5cf964748-d8zhr to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-1d482894-56c95f9f44-m528s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-1d482894-56c95f9f44-m528s to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-477fd9c0-85c844f66d-m44hc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-477fd9c0-85c844f66d-m44hc to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-477fd9c0-85c844f66d-x6xln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-477fd9c0-85c844f66d-x6xln to ip-10-0-142-167.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-zp9tr

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-zp9tr to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-75b361-5d9d794d86-dlpq7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-75b361-5d9d794d86-dlpq7 to ip-10-0-132-214.us-east-2.compute.internal

opendatahub

test-curl-7337-fbeb2b

Scheduled

Successfully assigned opendatahub/test-curl-7337-fbeb2b to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-490cdf-6d869df5dd-kqf6m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-490cdf-6d869df5dd-kqf6m to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-c9d69c-844759994d-x4kmk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c9d69c-844759994d-x4kmk to ip-10-0-141-42.us-east-2.compute.internal

cert-manager

cert-manager-597b95cb84-ljcm7

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-ljcm7 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-zzkkt to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-927bf8-6df68dcfdd-6rppj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-927bf8-6df68dcfdd-6rppj to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-x6hbg to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-sjbzh to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-sbbjg to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-b17e94-b96ddfb96-9dkqk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-b17e94-b96ddfb96-9dkqk to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-rgs5c to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8-d8qxp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8-d8qxp to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-rbwvb to ip-10-0-141-42.us-east-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-cs6bc

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cs6bc to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-a29f33-5ffb5696f4-v88tb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-a29f33-5ffb5696f4-v88tb to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-mhqnr to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-ldmb6 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-hc22z to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-f6lcg to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-d5bck

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-d5bck to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-c1768b-7784fb67fb-jnzk6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-c1768b-7784fb67fb-jnzk6 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-clbw6 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6-bcw9b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6-bcw9b to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-c2lhh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-c2lhh to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj to ip-10-0-132-214.us-east-2.compute.internal

opendatahub

test-curl-7334-68df11

Scheduled

Successfully assigned opendatahub/test-curl-7334-68df11 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-0897eecc-75774c584b-cqx28

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0897eecc-75774c584b-cqx28 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-qnsqx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-qnsqx to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v to ip-10-0-141-42.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-9lwvc to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-84zhb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-84zhb to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-f03120-79bf49bdd6-z9zzs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f03120-79bf49bdd6-z9zzs to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-5jtlw to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2rj4k to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw to ip-10-0-141-42.us-east-2.compute.internal

opendatahub

test-curl-7334-54897d

Scheduled

Successfully assigned opendatahub/test-curl-7334-54897d to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-5f78687d5b-dkcrs

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-dkcrs to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k to ip-10-0-132-214.us-east-2.compute.internal

opendatahub

test-curl-7334-2c1f58

Scheduled

Successfully assigned opendatahub/test-curl-7334-2c1f58 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-0eeba5-75c6455594-8kbxt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-0eeba5-75c6455594-8kbxt to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5 to ip-10-0-142-167.us-east-2.compute.internal

opendatahub

test-curl-7334-1b6145

Scheduled

Successfully assigned opendatahub/test-curl-7334-1b6145 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2 to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-gjmfm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-gjmfm to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-5b99845f6f-rqs6w

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5b99845f6f-rqs6w to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-s84hv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-s84hv to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs to ip-10-0-132-214.us-east-2.compute.internal

opendatahub

ai-gateway-controller-5c494664d6-7lvd2

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5c494664d6-7lvd2 to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8 to ip-10-0-141-42.us-east-2.compute.internal

opendatahub

test-curl-7325-40b08f

Scheduled

Successfully assigned opendatahub/test-curl-7325-40b08f to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-5b99845f6f-qb5pq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5b99845f6f-qb5pq to ip-10-0-141-42.us-east-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-bw5xh

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-bw5xh to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-s74hk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-s74hk to ip-10-0-142-167.us-east-2.compute.internal

opendatahub

test-curl-7325-2b3c41

Scheduled

Successfully assigned opendatahub/test-curl-7325-2b3c41 to ip-10-0-132-214.us-east-2.compute.internal

opendatahub

test-curl-7325-14a184

Scheduled

Successfully assigned opendatahub/test-curl-7325-14a184 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-9msfb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9msfb to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-8q54p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-8q54p to ip-10-0-142-167.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-h486p

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-h486p to ip-10-0-132-214.us-east-2.compute.internal

opendatahub

test-curl-7325-0f2cc4

Scheduled

Successfully assigned opendatahub/test-curl-7325-0f2cc4 to ip-10-0-141-42.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-blshw

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-blshw to ip-10-0-141-42.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-wwgvc

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-wwgvc to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lhxgc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lhxgc to ip-10-0-141-42.us-east-2.compute.internal

opendatahub

maas-controller-5f44bf7884-smq9v

Scheduled

Successfully assigned opendatahub/maas-controller-5f44bf7884-smq9v to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4-4784l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4-4784l to ip-10-0-141-42.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-p8jcd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p8jcd to ip-10-0-142-167.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-grxfc

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-grxfc to ip-10-0-142-167.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-ks55n

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-ks55n to ip-10-0-132-214.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-l7rcc

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-l7rcc to ip-10-0-142-167.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-wjk89

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-wjk89 to ip-10-0-132-214.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-787bddbb47 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-787bddbb47

FailedCreate

Error creating: pods "router-default-787bddbb47-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-787bddbb47

SuccessfulCreate

Created pod: router-default-787bddbb47-hfcvw
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-787bddbb47-hfcvw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-787bddbb47-hfcvw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x2)

openshift-ingress

kubelet

router-default-787bddbb47-hfcvw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-787bddbb47-hfcvw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-787bddbb47-hfcvw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-787bddbb47-hfcvw

Created

Container created

openshift-ingress

kubelet

router-default-787bddbb47-hfcvw

Started

Container started

openshift-ingress

multus

router-default-787bddbb47-hfcvw

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-s74hk

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-s74hk

AddedInterface

Add eth0 [10.133.0.14/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-s74hk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-s74hk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.188s (3.188s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-s74hk

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-s74hk

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-s74hk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-7454465567

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-7454465567-q9n4s

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-7454465567 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-s74hk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7454465567-q9n4s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-7454465567-q9n4s

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.695s (3.695s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7454465567-q9n4s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.862s (3.862s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7454465567-q9n4s

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-7454465567-q9n4s

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-25jst

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-25jst

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-25jst

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-25jst

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-25jst

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.707s (2.707s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-25jst

Created

Container created
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-25jst_ff6ea614-c2ae-4bcf-9bf7-5703f7fcb12b became leader

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-78f5b8588d

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-78f5b8588d-hthgg

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-78f5b8588d

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-78f5b8588d-9gfr5

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-78f5b8588d

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-78f5b8588d-p5vzw

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-78f5b8588d from 0 to 3

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-bw5vt

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-bw5vt

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-hthgg

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-78f5b8588d-hthgg

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bw5vt

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-4g2vw

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.727s (2.727s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-hthgg

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-hthgg

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-hthgg

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bw5vt

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bw5vt

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.111s (3.111s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bw5vt

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.279s (3.279s including waiting). Image size: 309650901 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-hthgg

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.774s (2.774s including waiting). Image size: 273709574 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-4g2vw

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-4g2vw

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-4g2vw

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-hthgg

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 475ms (475ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 461ms (461ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-hthgg

Started

Container started

opendatahub-operator-system

opendatahub-operator-controller-manager-78f5b8588d-9gfr5_15526a22-6948-4608-a303-b5ac5234b489

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-78f5b8588d-9gfr5_15526a22-6948-4608-a303-b5ac5234b489 became leader

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-4g2vw

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 759ms (759ms including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-4g2vw

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-hthgg

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-9gfr5

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 500ms (500ms including waiting). Image size: 273709574 bytes.
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-78f5b8588d-p5vzw

Created

Container created

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-gbld7

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-gbld7

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-gbld7

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

opendatahub-operator-system

operator-lifecycle-manager

install-r6874

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-gbld7

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-gbld7

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-gbld7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.55s (2.55s including waiting). Image size: 167738465 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-ljcm7
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

authorino-operator-7b7bb4bc77-gbld7_a652a41d-928e-41fc-b389-0f0b5957e17d

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-gbld7_a652a41d-928e-41fc-b389-0f0b5957e17d became leader

cert-manager

multus

cert-manager-597b95cb84-ljcm7

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-ljcm7

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-ljcm7

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-ljcm7

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-4ttjv

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-4ttjv

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-4ttjv

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-mgclc

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-mgclc

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-mgclc

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-4ttjv

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-4ttjv

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-4ttjv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.12s (4.12s including waiting). Image size: 424244516 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-4ttjv_25275925-45fa-40b3-8a7c-5e233fca8075

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-4ttjv_25275925-45fa-40b3-8a7c-5e233fca8075 became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-mgclc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.798s (2.798s including waiting). Image size: 190804149 bytes.

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-gmgtn

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-6pvgl

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-gmgtn

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-mgclc

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-mgclc

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-gmgtn

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-6pvgl

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6pvgl

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

dns-operator-controller-manager-8557cbdb84-mgclc_653f6592-85a9-4a61-bbf8-9fb8317f6f3c

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-mgclc_653f6592-85a9-4a61-bbf8-9fb8317f6f3c became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6pvgl

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6pvgl

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6pvgl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.571s (1.571s including waiting). Image size: 177967631 bytes.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-6pvgl_2cb08daf-1d1f-4b73-83fa-6804b45e3518

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-6pvgl_2cb08daf-1d1f-4b73-83fa-6804b45e3518 became leader

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-gmgtn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.821s (4.821s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-gmgtn

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-gmgtn

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-5b99845f6f

SuccessfulCreate

Created pod: kube-auth-proxy-5b99845f6f-rqs6w

openshift-ingress

multus

kube-auth-proxy-5b99845f6f-qb5pq

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6c786f9b57

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6c786f9b57kmt86

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6c786f9b57kmt86

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6c786f9b57kmt86

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6c786f9b57kmt86

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6c786f9b57kmt86

Started

Container started

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6c786f9b57 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5b99845f6f from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-5b99845f6f-qb5pq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-5b99845f6f-rqs6w

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5b99845f6f-rqs6w

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-5b99845f6f

SuccessfulCreate

Created pod: kube-auth-proxy-5b99845f6f-qb5pq

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-jz2dn

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jz2dn

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-jz2dn

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-2kq47

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-mgr5d

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-wjk89

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-2kq47

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-59fbh

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

authorino-57f7f8659f-mgr5d

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jz2dn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.356s (1.356s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jz2dn

Created

Container created

kuadrant-system

multus

authorino-57f7f8659f-mgr5d

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-7c9b87d574-2kq47

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5b99845f6f-qb5pq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.327s (2.327s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5b99845f6f-rqs6w

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5b99845f6f-rqs6w

Started

Container started

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-wjk89

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-wjk89

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-ingress

kubelet

kube-auth-proxy-5b99845f6f-qb5pq

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jz2dn

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5b99845f6f-qb5pq

Started

Container started

kuadrant-system

multus

authorino-56c6c9ddd5-59fbh

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-59fbh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

kube-auth-proxy-5b99845f6f-rqs6w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.347s (2.347s including waiting). Image size: 188904677 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-mgr5d

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.954s (1.954s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-mgr5d

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-mgr5d

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-wjk89

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-wjk89

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-2kq47

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.811s (2.811s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-2kq47

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-59fbh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.71s (2.71s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-2kq47

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-wjk89

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.518s (2.518s including waiting). Image size: 195729000 bytes.
(x4)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": tls: failed to verify certificate: x509: certificate signed by unknown authority

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-mgr5d

kuadrant-system

kubelet

authorino-56c6c9ddd5-59fbh

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-59fbh

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-mgr5d

Killing

Stopping container authorino

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jz2dn

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-jz2dn

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

opendatahub

kserve-module-controller-manager-7566cf5fc8-wjk89_00d25850-1b4c-4579-bc7a-67a169249cd8

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-wjk89_00d25850-1b4c-4579-bc7a-67a169249cd8 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5f44bf7884 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5cf964748 from 0 to 1

opendatahub

replicaset-controller

maas-controller-5cf964748

SuccessfulCreate

Created pod: maas-controller-5cf964748-d8zhr

opendatahub

multus

maas-controller-5f44bf7884-smq9v

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-5f44bf7884

SuccessfulCreate

Created pod: maas-controller-5f44bf7884-smq9v

opendatahub

kubelet

maas-controller-5f44bf7884-smq9v

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:f63068976bd050c4dc001adae2cf0dd31b7a15f5ec90aa61cd3eb068ac13b4dc"

opendatahub

multus

maas-controller-5cf964748-d8zhr

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5f44bf7884-smq9v

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:f63068976bd050c4dc001adae2cf0dd31b7a15f5ec90aa61cd3eb068ac13b4dc" in 4.775s (4.775s including waiting). Image size: 200069651 bytes.

opendatahub

kubelet

maas-controller-5f44bf7884-smq9v

Created

Container created

opendatahub

kubelet

maas-controller-5f44bf7884-smq9v

Started

Container started

opendatahub

kubelet

maas-controller-5cf964748-d8zhr

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:f63068976bd050c4dc001adae2cf0dd31b7a15f5ec90aa61cd3eb068ac13b4dc" in 4.243s (4.243s including waiting). Image size: 200069651 bytes.

opendatahub

maas-controller-5f44bf7884-smq9v_255e9c49-2f22-4479-8063-3475a1339f32

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5f44bf7884-smq9v_255e9c49-2f22-4479-8063-3475a1339f32 became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-89xm5

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-89xm5

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-89xm5

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-wwgvc

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-grxfc

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-ks55n

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-blshw

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-p8jcd

opendatahub

kubelet

model-serving-api-75bd89fdfc-wwgvc

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

odh-model-controller-769875db56-blshw

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-grxfc

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

odh-model-controller-769875db56-blshw

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

multus

model-serving-api-75bd89fdfc-wwgvc

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-grxfc

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-ks55n

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-ks55n

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-p8jcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-p8jcd

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-p8jcd

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-p8jcd

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-s74hk

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-s74hk

Killing

Stopping container discovery

opendatahub

kubelet

kserve-controller-manager-776cc66d47-grxfc

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-grxfc

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.22s (2.22s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-wwgvc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 1.992s (1.992s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-wwgvc

Started

Container started

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-wwgvc

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-ks55n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 1.679s (1.679s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-ks55n

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-ks55n

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-grxfc

Created

Container created

opendatahub

odh-model-controller-769875db56-blshw_5798f3c7-30c7-44fe-b2f4-daae78163fff

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-blshw_5798f3c7-30c7-44fe-b2f4-daae78163fff became leader

opendatahub

kubelet

odh-model-controller-769875db56-blshw

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-blshw

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-blshw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.782s (2.782s including waiting). Image size: 236755567 bytes.

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-5f44bf7884 from 1 to 0

opendatahub

kubelet

maas-controller-5f44bf7884-smq9v

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-5f44bf7884

SuccessfulDelete

Deleted pod: maas-controller-5f44bf7884-smq9v

opendatahub

kserve-controller-manager-776cc66d47-grxfc_caf2a77c-6f2e-4811-9453-d147cfa60977

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-grxfc_caf2a77c-6f2e-4811-9453-d147cfa60977 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-ks55n_27f08f1a-5d06-4f86-a9e8-39ba9f025012

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-ks55n_27f08f1a-5d06-4f86-a9e8-39ba9f025012 became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-89xm5

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-89xm5

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-89xm5

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 13.125s (13.125s including waiting). Image size: 1089502687 bytes.

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-8fnbb"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-qkwkp"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-fd8cbc9d9

SuccessfulCreate

Created pod: jobset-controller-manager-fd8cbc9d9-m5t29

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-fd8cbc9d9 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-fd8cbc9d9-m5t29

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

multus

jobset-controller-manager-fd8cbc9d9-m5t29

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-fd8cbc9d9-m5t29

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-fd8cbc9d9-m5t29

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.211s (3.211s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-fd8cbc9d9-m5t29

Created

Container created

openshift-jobset-operator

jobset-controller-manager-fd8cbc9d9-m5t29_f0de9250-c4c8-4594-9973-c886068d01ee

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-fd8cbc9d9-m5t29_f0de9250-c4c8-4594-9973-c886068d01ee became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

maas-controller-5cf964748-d8zhr_5269bd13-9c84-4ccf-a27d-4a49db6d3878

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5cf964748-d8zhr_5269bd13-9c84-4ccf-a27d-4a49db6d3878 became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-8fshs

kuadrant-system

multus

authorino-6889cbd8c4-8fshs

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulCreate

Created pod: authorino-6dd76875b5-2ws5q

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6dd76875b5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-8fshs

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6dd76875b5 from 1 to 0

kuadrant-system

kubelet

authorino-6889cbd8c4-8fshs

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-84f585c5

SuccessfulCreate

Created pod: authorino-84f585c5-n9z4n

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulDelete

Deleted pod: authorino-6dd76875b5-2ws5q

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-84f585c5 from 0 to 1

kuadrant-system

multus

authorino-84f585c5-n9z4n

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-84f585c5-n9z4n

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6889cbd8c4-8fshs

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-8fshs

Created

Container created

kuadrant-system

kubelet

authorino-6889cbd8c4-8fshs

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 935ms (935ms including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-59fbh

kuadrant-system

kubelet

authorino-56c6c9ddd5-59fbh

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-6889cbd8c4-8fshs

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-84f585c5-n9z4n

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 860ms (860ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-84f585c5-n9z4n

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused

kuadrant-system

kubelet

authorino-84f585c5-n9z4n

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-l7rcc

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-l7rcc

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-l7rcc

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-l7rcc

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-l7rcc

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-l7rcc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 1.704s (1.704s including waiting). Image size: 235100981 bytes.
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-ks55n

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-ks55n

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-bw5xh

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bw5xh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-bw5xh

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bw5xh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.461s (2.461s including waiting). Image size: 183926184 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bw5xh

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bw5xh

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

opendatahub

ai-gateway-controller-7d85675f98-bw5xh_0e7a188d-f6d2-471f-b4fa-dbb276d21b02

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-bw5xh_0e7a188d-f6d2-471f-b4fa-dbb276d21b02 became leader

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-dkcrs

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-2j4r6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

kubelet

payload-processing-5f78687d5b-dkcrs

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-5f78687d5b-dkcrs

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2j4r6

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-2j4r6

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2j4r6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2j4r6

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-dkcrs

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-dkcrs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.197s (2.197s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-dkcrs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2j4r6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.194s (2.194s including waiting). Image size: 125353965 bytes.

opendatahub

llmisvc-controller-manager-6466c554d8-l7rcc_b2501c53-fb10-49ef-a926-88684cfcd75f

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-l7rcc_b2501c53-fb10-49ef-a926-88684cfcd75f became leader

opendatahub

replicaset-controller

ai-gateway-controller-5c494664d6

SuccessfulCreate

Created pod: ai-gateway-controller-5c494664d6-7lvd2

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5c494664d6 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-5c494664d6-7lvd2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-5c494664d6-7lvd2

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-5c494664d6-7lvd2

Started

Container started

opendatahub

kubelet

ai-gateway-controller-5c494664d6-7lvd2

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5c494664d6-7lvd2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 398ms (398ms including waiting). Image size: 183926184 bytes.

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-bw5xh

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bw5xh

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-k5q55

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-k5q55

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-k5q55

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-k5q55

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-k5q55

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-k5q55

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.32s (1.32s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-kkzgw

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kkzgw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-kkzgw

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-6jh27

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-6jh27

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 272ms (272ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-6jh27

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-6jh27

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kkzgw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.368s (1.368s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kkzgw

Created

Container created

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-6jh27

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kkzgw

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-6jh27

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-jt9lh

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-jt9lh

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-jt9lh

opendatahub

ai-gateway-controller-5c494664d6-7lvd2_ad2d364d-1b46-4ddf-9869-47cbe7f16be3

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5c494664d6-7lvd2_ad2d364d-1b46-4ddf-9869-47cbe7f16be3 became leader

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-jt9lh

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 284ms (284ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-jt9lh

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-jt9lh

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-5cf964748-d8zhr

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:f63068976bd050c4dc001adae2cf0dd31b7a15f5ec90aa61cd3eb068ac13b4dc"

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8zcm5m

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

opendatahub

kubelet

maas-controller-5cf964748-d8zhr

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:f63068976bd050c4dc001adae2cf0dd31b7a15f5ec90aa61cd3eb068ac13b4dc" in 520ms (520ms including waiting). Image size: 200069651 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8zcm5m

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-5cf964748-d8zhr

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-5cf964748-d8zhr

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8zcm5m

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8zcm5m

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 285ms (285ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8zcm5m

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8zcm5m

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-zp9tr

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

multus

echo-simulator-kserve-64b6f8f96c-zp9tr

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zp9tr

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-cs6bc

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cs6bc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-cs6bc

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cs6bc

Created

Container created

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zp9tr

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.836s (1.836s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cs6bc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 345ms (345ms including waiting). Image size: 98346788 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zp9tr

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zp9tr

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cs6bc

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 334ms (334ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Created

Container created

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

opendatahub

maas-controller-5cf964748-d8zhr_9caebb03-cf90-47c0-b44f-82085c8ac605

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5cf964748-d8zhr_9caebb03-cf90-47c0-b44f-82085c8ac605 became leader

kuadrant-system

replicaset-controller

authorino-5677757b6d

SuccessfulCreate

Created pod: authorino-5677757b6d-m57tz

kuadrant-system

multus

authorino-5677757b6d-m57tz

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5677757b6d-m57tz

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-5677757b6d-m57tz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 971ms (971ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5677757b6d-m57tz

Created

Container created

kuadrant-system

kubelet

authorino-5677757b6d-m57tz

Started

Container started
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-84f585c5 from 1 to 0

kuadrant-system

kubelet

authorino-84f585c5-n9z4n

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-84f585c5

SuccessfulDelete

Deleted pod: authorino-84f585c5-n9z4n

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-hc22z

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.944s (2.944s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.577s (3.577s including waiting). Image size: 183555333 bytes.
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

Unhealthy

Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

ProbeError

Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 4 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-clbw6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-migrate-1d482894-gw-openshift-default-777776b6d9

SuccessfulCreate

Created pod: e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

openshift-ingress

replicaset-controller

e2e-ait-b33c04be-openshift-default-7b5d78d77

SuccessfulCreate

Created pod: e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw

openshift-ingress

deployment-controller

e2e-ait-3a55af38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3a55af38-openshift-default-5bb87d5f65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-b33c04be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b33c04be

openshift-ingress

deployment-controller

e2e-migrate-1d482894-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-1d482894-gw-openshift-default-777776b6d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-3a55af38-openshift-default-5bb87d5f65

SuccessfulCreate

Created pod: e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

openshift-ingress

multus

e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-3a55af38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3a55af38

openshift-ingress

gateway_labeler_controller

e2e-migrate-1d482894-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-1d482894-gw

openshift-ingress

deployment-controller

e2e-ait-b33c04be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b33c04be-openshift-default-7b5d78d77 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-0897eecc-openshift-default-7b455f4b85

SuccessfulCreate

Created pod: e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc

openshift-ingress

multus

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-0897eecc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0897eecc-openshift-default-7b455f4b85 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-0897eecc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0897eecc

openshift-ingress

multus

e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-1d482894-6fc5774b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-1d482894-6fc5774b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-1d482894: serviceaccount "payload-processing-e2e-migrate-1d482894" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-1d482894

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-1d482894-6fc5774b99 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-1d482894-56c95f9f44

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-1d482894-56c95f9f44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-1d482894: serviceaccount "payload-processing-e2e-migrate-1d482894" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-1d482894

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-1d482894-56c95f9f44 from 0 to 1

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

openshift-ingress

multus

payload-processing-e2e-migrate-1d482894-56c95f9f44-m528s

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1d482894-6fc5774b99-msqpt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3a55af38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3a55af38-6f454d75c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3a55af38-6f454d75c4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3a55af38-6f454d75c4-s62sm

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-1d482894-56c95f9f44

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-1d482894-56c95f9f44-m528s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3a55af38-6f454d75c4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3a55af38-6f454d75c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3a55af38: serviceaccount "payload-processing-e2e-ait-3a55af38" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-1d482894-56c95f9f44-m528s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-1d482894-56c95f9f44-m528s

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3a55af38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3a55af38-65c8454759 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3a55af38-65c8454759

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3a55af38-65c8454759-5gbpz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-1d482894-6fc5774b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-1d482894-6fc5774b99-msqpt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3a55af38-65c8454759

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3a55af38-65c8454759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3a55af38: serviceaccount "payload-processing-e2e-ait-3a55af38" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1d482894-6fc5774b99-msqpt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1d482894-6fc5774b99-msqpt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-migrate-1d482894-6fc5774b99-msqpt

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-1d482894-56c95f9f44-m528s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-3a55af38-6f454d75c4-s62sm

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-3a55af38-6f454d75c4-s62sm

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b33c04be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b33c04be-5c89c4c68b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b33c04be-5c89c4c68b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b33c04be-5c89c4c68b-59jpz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b33c04be-5c89c4c68b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b33c04be-5c89c4c68b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b33c04be: serviceaccount "payload-processing-e2e-ait-b33c04be" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b33c04be-59455ff787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b33c04be-59455ff787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b33c04be: serviceaccount "payload-processing-e2e-ait-b33c04be" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b33c04be-59455ff787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b33c04be-59455ff787-47bln

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b33c04be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b33c04be-59455ff787 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a55af38-65c8454759-5gbpz

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-3a55af38-65c8454759-5gbpz

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-b33c04be-59455ff787-47bln

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b33c04be-59455ff787-47bln

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0897eecc-f5b95bc79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0897eecc: serviceaccount "payload-processing-e2e-ait-0897eecc" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-b33c04be-5c89c4c68b-59jpz

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0897eecc-f5b95bc79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-4x62h

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0897eecc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0897eecc-75774c584b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0897eecc-75774c584b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0897eecc-75774c584b-cqx28
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0897eecc-75774c584b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0897eecc-75774c584b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0897eecc: serviceaccount "payload-processing-e2e-ait-0897eecc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0897eecc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0897eecc-f5b95bc79 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-b33c04be-5c89c4c68b-59jpz

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0897eecc-75774c584b-cqx28

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-0897eecc-75774c584b-cqx28

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-4x62h

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-4x62h

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

gateway_labeler_controller

e2e-derive-d05eeacd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-d05eeacd

openshift-ingress

deployment-controller

e2e-derive-d05eeacd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-d05eeacd-openshift-default-86c5d8956f from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-d05eeacd-openshift-default-86c5d8956f

SuccessfulCreate

Created pod: e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-4x62h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.879s (2.879s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a55af38-65c8454759-5gbpz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-3a55af38-6f454d75c4-s62sm

Started

Container started

openshift-ingress

multus

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-3a55af38-6f454d75c4-s62sm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-3a55af38-6f454d75c4-s62sm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.685s (4.685s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-0897eecc-75774c584b-cqx28

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-0897eecc-75774c584b-cqx28

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-0897eecc-75774c584b-cqx28

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.887s (2.887s including waiting). Image size: 125353965 bytes.
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-4x62h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-4x62h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a55af38-65c8454759-5gbpz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.003s (5.003s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a55af38-65c8454759-5gbpz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-b33c04be-5c89c4c68b-59jpz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.727s (4.727s including waiting). Image size: 125353965 bytes.
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-b33c04be-5c89c4c68b-59jpz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b33c04be-59455ff787-47bln

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b33c04be-59455ff787-47bln

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.734s (4.734s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b33c04be-59455ff787-47bln

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-b33c04be-5c89c4c68b-59jpz

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d05eeacd: serviceaccount "payload-processing-e2e-derive-d05eeacd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-d05eeacd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-d05eeacd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-d05eeacd-596f4f9cb6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7-lmrkw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d05eeacd-596f4f9cb6

SuccessfulCreate

Created pod: payload-processing-e2e-derive-d05eeacd-596f4f9cb6-tkmg2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d05eeacd-596f4f9cb6

FailedCreate

Error creating: pods "payload-processing-e2e-derive-d05eeacd-596f4f9cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d05eeacd: serviceaccount "payload-processing-e2e-derive-d05eeacd" not found

openshift-ingress

multus

payload-processing-e2e-derive-d05eeacd-596f4f9cb6-tkmg2

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7-lmrkw

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7-lmrkw

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7-lmrkw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-d05eeacd-596f4f9cb6-tkmg2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-d05eeacd-596f4f9cb6-tkmg2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-d05eeacd-596f4f9cb6-tkmg2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7-lmrkw

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-1d482894-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-1d482894-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-b33c04be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-b33c04be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3a55af38-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3a55af38-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0897eecc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0897eecc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

Started

Container started

openshift-ingress

kubelet

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1d482894-6fc5774b99-msqpt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc

Created

Container created

openshift-ingress

kubelet

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-1d482894-56c95f9f44-m528s

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-b33c04be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3a55af38-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3a55af38-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-b33c04be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-migrate-1d482894-gw-openshift-default-777776b6d9-r4z4f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-c1fdd6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-c1fdd6

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0897eecc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0897eecc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a55af38-65c8454759-5gbpz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3a55af38-6f454d75c4-s62sm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b33c04be-59455ff787-47bln

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b33c04be-5c89c4c68b-59jpz

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-0897eecc-75774c584b-cqx28

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0897eecc-f5b95bc79-4x62h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-3a55af38-openshift-default-5bb87d5f65-hkdt7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-ccgjb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-c1fdd6-76556ddfb

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-c1fdd6: serviceaccount "payload-processing-e2e-worker-w3-c1fdd6" not found

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-c1fdd6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-c1fdd6: serviceaccount "payload-processing-e2e-worker-w3-c1fdd6" not found

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-f06af6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-f06af6

openshift-ingress

kubelet

e2e-ait-b33c04be-openshift-default-7b5d78d77-q29rw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-c1fdd6-76556ddfb

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-w9t9z

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-c1fdd6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-c1fdd6-76556ddfb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-ccgjb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-ccgjb

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-w9t9z

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-w9t9z

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-ccgjb

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-w9t9z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-ccgjb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-w9t9z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-2a3e1b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-2a3e1b

openshift-ingress

multus

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-d05eeacd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-d05eeacd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7

SuccessfulCreate

Created pod: e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t

openshift-ingress

deployment-controller

e2e-worker-w4-2a3e1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7 from 0 to 1

openshift-ingress

kubelet

e2e-ait-0897eecc-openshift-default-7b455f4b85-bhftc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-d05eeacd-596f4f9cb6-tkmg2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d05eeacd-6bb9664cb7-lmrkw

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-f06af6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-f06af6-77784df88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-8836a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-8836a8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-f06af6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

openshift-ingress

multus

payload-processing-e2e-worker-w2-f06af6-77784df88-qg6p6

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f06af6-77784df88-qg6p6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f06af6-77784df88-qg6p6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f06af6-77784df88-qg6p6

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-f06af6-77784df88

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-f06af6-77784df88-qg6p6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-2a3e1b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-f06af6: serviceaccount "payload-processing-e2e-worker-w2-f06af6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-2a3e1b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-f06af6-77784df88

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-f06af6-77784df88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-f06af6: serviceaccount "payload-processing-e2e-worker-w2-f06af6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-gjmfm

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-sdp74
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-2a3e1b: serviceaccount "payload-processing-e2e-worker-w4-2a3e1b" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-2a3e1b: serviceaccount "payload-processing-e2e-worker-w4-2a3e1b" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-sdp74

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-gjmfm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-gjmfm

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-sdp74

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-d05eeacd-openshift-default-86c5d8956f-fgrb7

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-sdp74

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-gjmfm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-7a745c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-7a745c

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulCreate

Created pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-gjmfm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-sdp74

Started

Container started

openshift-ingress

multus

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-8836a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-8836a8-7f7565d946 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-8836a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8836a8-7f7565d946-zl9c7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-8836a8-7f7565d946-zl9c7

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-vc4fk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-vc4fk

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8836a8-7f7565d946

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-8836a8-7f7565d946-zl9c7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8836a8-7f7565d946

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-8836a8-7f7565d946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8836a8: serviceaccount "payload-processing-e2e-worker-w0-8836a8" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8836a8-7f7565d946-zl9c7

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8836a8: serviceaccount "payload-processing-e2e-worker-w0-8836a8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-vc4fk

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-vc4fk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8836a8-7f7565d946-zl9c7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-vc4fk

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-7a745c: serviceaccount "payload-processing-e2e-worker-w1-7a745c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-bf7sk

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-7a745c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-7a745c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-7a745c-69b56f599 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-7a745c: serviceaccount "payload-processing-e2e-worker-w1-7a745c" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-bf7sk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-bf7sk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-bf7sk

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-bf7sk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-h486p

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h486p

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-h486p

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h486p

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h486p

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.456s (3.456s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h486p

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h486p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h486p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-2a3e1b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-2a3e1b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-2a3e1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7

SuccessfulCreate

Created pod: e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-2a3e1b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulCreate

Created pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 2 to 4

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

Started

Container started

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 4 to 5
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

ProbeError

Readiness probe error: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

Unhealthy

Readiness probe failed: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

Started

Container started

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 2 to 4

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 5 to 7

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 4 to 8

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

Created

Container created

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

Created

Container created

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 8 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

Started

Container started

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 4 to 8

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q

Started

Container started

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 8 to 10

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

ProbeError

Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

Unhealthy

Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-2a3e1b-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-2a3e1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7

SuccessfulCreate

Created pod: e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

openshift-ingress

multus

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-a-07292b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-07292b

openshift-ingress

replicaset-controller

e2e-api-a-07292b-openshift-default-744696b8d9

SuccessfulCreate

Created pod: e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

openshift-ingress

multus

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-07292b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-07292b-openshift-default-744696b8d9 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

Unhealthy

Readiness probe failed: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

Unhealthy

Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

ProbeError

Readiness probe error: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

ProbeError

Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-07292b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-07292b-74459b4d58 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-07292b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-07292b-74459b4d58

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-07292b-74459b4d58-g8xfm
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Unhealthy

Readiness probe failed: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5-m67zk
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

ProbeError

Readiness probe error: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-07292b-74459b4d58

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-07292b-74459b4d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-07292b: serviceaccount "payload-processing-e2e-api-a-07292b" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-07292b: serviceaccount "payload-processing-e2e-api-a-07292b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5-m67zk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5-m67zk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5-m67zk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-07292b-74459b4d58-g8xfm

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5-m67zk

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-477fd9c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-477fd9c0

openshift-ingress

kubelet

payload-processing-e2e-api-a-07292b-74459b4d58-g8xfm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-07292b-74459b4d58-g8xfm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-07292b-74459b4d58-g8xfm

Started

Container started

openshift-ingress

deployment-controller

e2e-mt-477fd9c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-477fd9c0-openshift-default-647479cffc from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-477fd9c0-openshift-default-647479cffc

SuccessfulCreate

Created pod: e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g

openshift-ingress

multus

e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-477fd9c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-477fd9c0-85c844f66d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-z7bmj

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-477fd9c0-85c844f66d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-477fd9c0-85c844f66d-m44hc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-477fd9c0-85c844f66d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-477fd9c0-85c844f66d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-477fd9c0: serviceaccount "payload-processing-e2e-mt-477fd9c0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-477fd9c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-z7bmj

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-z7bmj

openshift-ingress

kubelet

payload-processing-e2e-mt-477fd9c0-85c844f66d-m44hc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-z7bmj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-477fd9c0-85c844f66d-m44hc

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-477fd9c0: serviceaccount "payload-processing-e2e-mt-477fd9c0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-z7bmj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-477fd9c0-85c844f66d-m44hc

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-477fd9c0-85c844f66d-m44hc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-2a3e1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7 from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-2a3e1b-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7

SuccessfulCreate

Created pod: e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

openshift-ingress

replicaset-controller

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7

SuccessfulCreate

Created pod: e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

openshift-ingress

gateway_labeler_controller

e2e-api-b-6ac47d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-6ac47d

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

Created

Container created

openshift-ingress

deployment-controller

e2e-api-b-6ac47d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-6ac47d-openshift-default-7f95bfc97 from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-bw5vt

Unhealthy

Readiness probe failed: Get "http://10.134.0.29:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-6ac47d-openshift-default-7f95bfc97

SuccessfulCreate

Created pod: e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

Created

Container created

openshift-ingress

multus

e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6ac47d-7b459856ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-6ac47d-7b459856ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6ac47d: serviceaccount "payload-processing-e2e-api-b-6ac47d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6ac47d-7b459856ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-6ac47d-7b459856ff-w6ttx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-6ac47d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-6ac47d-7b459856ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-6ac47d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-6ac47d-7544f97974 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6ac47d-7544f97974

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-6ac47d-7544f97974-s4cp5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6ac47d-7544f97974

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-6ac47d-7544f97974-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6ac47d: serviceaccount "payload-processing-e2e-api-b-6ac47d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6ac47d-7b459856ff-w6ttx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-6ac47d-7b459856ff-w6ttx

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-6ac47d-7544f97974-s4cp5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-6ac47d-7544f97974-s4cp5

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6ac47d-7b459856ff-w6ttx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6ac47d-7b459856ff-w6ttx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-6ac47d-7544f97974-s4cp5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-6ac47d-7544f97974-s4cp5

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

Unhealthy

Readiness probe failed: Get "http://10.134.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

ProbeError

Readiness probe error: Get "http://10.134.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulCreate

Created pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulCreate

Created pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-07292b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-07292b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

Created

Container created

openshift-ingress

multus

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6ac47d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6ac47d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulCreate

Created pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

openshift-ingress

multus

e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 4 to 5

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-07292b-6c54c6b8c5-m67zk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-07292b-74459b4d58-g8xfm

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-477fd9c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-477fd9c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-07292b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-07292b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

ProbeError

Readiness probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-07292b-openshift-default-744696b8d9-pljg8

Unhealthy

Readiness probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6ac47d-7b459856ff-w6ttx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-6ac47d-7544f97974-s4cp5

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-477fd9c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-477fd9c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7325-40b08f

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7325-40b08f

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-40b08f

Started

Container started

opendatahub

kubelet

test-curl-7325-40b08f

Created

Container created

opendatahub

kubelet

test-curl-7325-40b08f

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 869ms (869ms including waiting). Image size: 106100986 bytes.
(x2)

openshift-ingress

kubelet

e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7325-40b08f

Killing

Stopping container test-curl-7325-40b08f
(x6)

openshift-ingress

kubelet

e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-6ac47d-openshift-default-7f95bfc97-4w6bq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-z7bmj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-477fd9c0-85c844f66d-m44hc

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-api-a-501ac8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-501ac8-openshift-default-6d65bf456f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-501ac8-openshift-default-6d65bf456f

SuccessfulCreate

Created pod: e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

openshift-ingress

gateway_labeler_controller

e2e-api-a-501ac8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-501ac8

openshift-ingress

multus

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-501ac8-768b76884b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-501ac8-768b76884b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-501ac8: serviceaccount "payload-processing-e2e-api-a-501ac8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-501ac8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-501ac8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-501ac8-768b76884b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-501ac8: serviceaccount "payload-processing-e2e-api-a-501ac8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-501ac8-768b76884b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-501ac8-768b76884b-8wrfj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c-bnggs

openshift-ingress

kubelet

payload-processing-e2e-api-a-501ac8-768b76884b-8wrfj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-501ac8-768b76884b-8wrfj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-501ac8-768b76884b-8wrfj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-501ac8-768b76884b-8wrfj

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c-bnggs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c-bnggs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c-bnggs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c-bnggs

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulCreate

Created pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulCreate

Created pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 5 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulCreate

Created pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

openshift-ingress

multus

e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulCreate

Created pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

Started

Container started

openshift-ingress

multus

e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

Started

Container started

openshift-ingress

multus

e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-z7bmj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-477fd9c0-85c844f66d-m44hc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-477fd9c0-85c844f66d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-477fd9c0-85c844f66d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-477fd9c0: serviceaccount "payload-processing-e2e-mt-477fd9c0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-477fd9c0-85c844f66d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-477fd9c0-85c844f66d-x6xln

openshift-ingress

deployment-controller

payload-processing-e2e-mt-477fd9c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-477fd9c0-85c844f66d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-477fd9c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-sggp9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-477fd9c0: serviceaccount "payload-processing-e2e-mt-477fd9c0" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-477fd9c0-85c844f66d-x6xln

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-mt-477fd9c0-85c844f66d-x6xln

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-477fd9c0-85c844f66d-x6xln

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-477fd9c0-85c844f66d-x6xln

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-sggp9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-sggp9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-sggp9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-sggp9

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-2761c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2761c7-openshift-default-5dc5fd95b7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-2761c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2761c7

openshift-ingress

replicaset-controller

e2e-api-b-2761c7-openshift-default-5dc5fd95b7

SuccessfulCreate

Created pod: e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r

openshift-ingress

multus

e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

ProbeError

Readiness probe error: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

Unhealthy

Readiness probe failed: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2761c7-776cb78fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2761c7-776cb78fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2761c7: serviceaccount "payload-processing-e2e-api-b-2761c7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2761c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2761c7-86c888b596 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2761c7-86c888b596

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2761c7-86c888b596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2761c7: serviceaccount "payload-processing-e2e-api-b-2761c7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2761c7-86c888b596

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2761c7-86c888b596-7b8d5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2761c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2761c7-776cb78fff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2761c7-776cb78fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2761c7-776cb78fff-k5tqc

openshift-ingress

kubelet

payload-processing-e2e-api-b-2761c7-86c888b596-7b8d5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-2761c7-86c888b596-7b8d5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-2761c7-86c888b596-7b8d5

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-2761c7-86c888b596-7b8d5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2761c7-776cb78fff-k5tqc

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2761c7-776cb78fff-k5tqc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2761c7-776cb78fff-k5tqc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2761c7-776cb78fff-k5tqc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-501ac8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-501ac8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7325-0f2cc4

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7325-0f2cc4

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-0f2cc4

Started

Container started

opendatahub

kubelet

test-curl-7325-0f2cc4

Created

Container created

opendatahub

kubelet

test-curl-7325-0f2cc4

Killing

Stopping container test-curl-7325-0f2cc4

openshift-ingress

deployment-controller

e2e-ipp-a-913351-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-913351-openshift-default-579dcdf795 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-913351

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-913351

openshift-ingress

replicaset-controller

e2e-ipp-a-913351-openshift-default-579dcdf795

SuccessfulCreate

Created pod: e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf

openshift-ingress

multus

e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-913351

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-913351-5587d6644c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-913351

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-913351-64c79d9748 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-913351-64c79d9748

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-913351-64c79d9748-wzvj5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-913351-5587d6644c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-913351-5587d6644c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-913351: serviceaccount "payload-processing-e2e-ipp-a-913351" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-913351-5587d6644c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-913351-5587d6644c-25q64
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-913351-64c79d9748

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-913351-64c79d9748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-913351: serviceaccount "payload-processing-e2e-ipp-a-913351" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-913351-64c79d9748-wzvj5

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-913351-5587d6644c-25q64

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-477fd9c0-85c844f66d-x6xln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-501ac8-768b76884b-8wrfj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-913351-64c79d9748-wzvj5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-913351-64c79d9748-wzvj5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-501ac8-dd4dc7b8c-bnggs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-913351-5587d6644c-25q64

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-913351-64c79d9748-wzvj5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-477fd9c0-84cd565b7f-sggp9

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-913351-5587d6644c-25q64

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-913351-5587d6644c-25q64

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-501ac8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-501ac8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c9d69c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c9d69c

openshift-ingress

deployment-controller

e2e-ipp-a-c9d69c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c9d69c-openshift-default-7cf99b5679 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679

SuccessfulCreate

Created pod: e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

openshift-ingress

multus

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c9d69c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955-lkr9q

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c9d69c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c9d69c-844759994d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9d69c: serviceaccount "payload-processing-e2e-ipp-a-c9d69c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9d69c-844759994d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c9d69c-844759994d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9d69c: serviceaccount "payload-processing-e2e-ipp-a-c9d69c" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9d69c-844759994d-x4kmk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955-lkr9q

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955-lkr9q

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955-lkr9q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955-lkr9q

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-c9d69c-844759994d-x4kmk

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9d69c-844759994d-x4kmk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9d69c-844759994d-x4kmk

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9d69c-844759994d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c9d69c-844759994d-x4kmk

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-913351-64c79d9748-wzvj5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-913351-5587d6644c-25q64

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-913351-5fdf8855f8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-913351-5fdf8855f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-913351: serviceaccount "payload-processing-e2e-ipp-a-913351" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-913351

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-913351-5fdf8855f8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-913351

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-913351-69b8cfd859 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-913351-69b8cfd859

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-pv667

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-913351-5fdf8855f8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-913351-5fdf8855f8-cmg2s
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-913351-69b8cfd859

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-913351: serviceaccount "payload-processing-e2e-ipp-a-913351" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-913351-5fdf8855f8-cmg2s

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-913351-5fdf8855f8-cmg2s

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-pv667

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-pv667

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-501ac8-openshift-default-6d65bf456f-vptb7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-913351-5fdf8855f8-cmg2s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-913351-5fdf8855f8-cmg2s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-913351-5fdf8855f8-cmg2s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.802s (3.802s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-pv667

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-pv667

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-pv667

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.589s (4.589s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-api-b-2761c7-86c888b596-7b8d5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2761c7-776cb78fff-k5tqc

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2761c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2761c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9d69c-844759994d-x4kmk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9d69c-fffd76955-lkr9q

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-api-a-1e3723-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1e3723-openshift-default-6fd569f6bc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-1e3723

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1e3723

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-lhxgc

openshift-ingress

replicaset-controller

e2e-api-a-1e3723-openshift-default-6fd569f6bc

SuccessfulCreate

Created pod: e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-lhxgc

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lhxgc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

e2e-ipp-b-59e21a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-59e21a-openshift-default-5ddffb659 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c9d69c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c9d69c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-59e21a-openshift-default-5ddffb659

SuccessfulCreate

Created pod: e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-59e21a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-59e21a

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lhxgc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.598s (3.598s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lhxgc

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lhxgc

Started

Container started

openshift-ingress

multus

e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9-8v6rk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9d69c-588d68c4db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c9d69c-588d68c4db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9d69c: serviceaccount "payload-processing-e2e-ipp-a-c9d69c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c9d69c-588d68c4db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c9d69c-588d68c4db-d9d4q

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1e3723

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1e3723-7664ccccb4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1e3723-7664ccccb4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1e3723-7664ccccb4-tl8pc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c9d69c: serviceaccount "payload-processing-e2e-ipp-a-c9d69c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c9d69c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1e3723-7664ccccb4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1e3723-7664ccccb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1e3723: serviceaccount "payload-processing-e2e-api-a-1e3723" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lhxgc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lhxgc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c9d69c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c9d69c-588d68c4db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1e3723-5b496fc79f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1e3723-5b496fc79f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1e3723: serviceaccount "payload-processing-e2e-api-a-1e3723" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1e3723-5b496fc79f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1e3723-5b496fc79f-r2slx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1e3723

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1e3723-5b496fc79f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-1e3723-7664ccccb4-tl8pc

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9-8v6rk

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9d69c-588d68c4db-d9d4q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9d69c-588d68c4db-d9d4q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e3723-7664ccccb4-tl8pc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9d69c-588d68c4db-d9d4q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e3723-5b496fc79f-r2slx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e3723-5b496fc79f-r2slx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e3723-7664ccccb4-tl8pc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-c9d69c-588d68c4db-d9d4q

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e3723-7664ccccb4-tl8pc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e3723-5b496fc79f-r2slx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9-8v6rk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9-8v6rk

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1e3723-5b496fc79f-r2slx

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9-8v6rk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-59e21a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-59e21a-75b5d75c8d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-59e21a: serviceaccount "payload-processing-e2e-ipp-b-59e21a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95-82slf

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-59e21a-75b5d75c8d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-59e21a-75b5d75c8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-59e21a: serviceaccount "payload-processing-e2e-ipp-b-59e21a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95-82slf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95-82slf

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95-82slf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-59e21a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-59e21a-75b5d75c8d-rbx6t

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-59e21a-75b5d75c8d-rbx6t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-59e21a-75b5d75c8d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-59e21a-75b5d75c8d-rbx6t

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-59e21a-75b5d75c8d-rbx6t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-59e21a-75b5d75c8d-rbx6t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95-82slf

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-040623

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-040623

openshift-ingress

deployment-controller

e2e-ipp-b-040623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-040623-openshift-default-74b5f7d8d7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-040623-openshift-default-74b5f7d8d7

SuccessfulCreate

Created pod: e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

openshift-ingress

multus

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-477fd9c0-openshift-default-647479cffc-8sl5g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

ProbeError

Readiness probe error: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

Unhealthy

Readiness probe failed: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-api-a-e907e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e907e4-openshift-default-5565b5d845 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-e907e4-openshift-default-5565b5d845

SuccessfulCreate

Created pod: e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

openshift-ingress

gateway_labeler_controller

e2e-api-a-e907e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e907e4

openshift-ingress

kubelet

e2e-api-b-2761c7-openshift-default-5dc5fd95b7-x6m5r

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-040623-5f54648f55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-040623-5f54648f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-040623: serviceaccount "payload-processing-e2e-ipp-b-040623" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-040623-577cc456d-sf9nq

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-040623-5f54648f55-hx52g

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-040623-5f54648f55-hx52g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-040623-5f54648f55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-040623-5f54648f55-hx52g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-040623

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-040623-5f54648f55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-040623-577cc456d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-040623-577cc456d-sf9nq

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-040623

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-040623-577cc456d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-040623-577cc456d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-040623-577cc456d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-040623: serviceaccount "payload-processing-e2e-ipp-b-040623" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-040623-577cc456d-sf9nq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-040623-577cc456d-sf9nq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-040623-5f54648f55-hx52g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-040623-5f54648f55-hx52g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-040623-577cc456d-sf9nq

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e907e4-64d884bb9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e907e4-64d884bb9f-2cp6w

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e907e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e907e4-654594658b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e907e4-654594658b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e907e4-654594658b-fw8n2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-913351-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-913351-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e907e4-64d884bb9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e907e4-64d884bb9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e907e4: serviceaccount "payload-processing-e2e-api-a-e907e4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e907e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e907e4-64d884bb9f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e907e4-654594658b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e907e4-654594658b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e907e4: serviceaccount "payload-processing-e2e-api-a-e907e4" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e907e4-64d884bb9f-2cp6w

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-4f2325

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-4f2325

openshift-ingress

replicaset-controller

e2e-ipp-a-4f2325-openshift-default-8569d95fc5

SuccessfulCreate

Created pod: e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

openshift-ingress

deployment-controller

e2e-ipp-a-4f2325-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-4f2325-openshift-default-8569d95fc5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e907e4-64d884bb9f-2cp6w

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1e3723-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1e3723-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e907e4-64d884bb9f-2cp6w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e907e4-64d884bb9f-2cp6w

Started

Container started

openshift-ingress

multus

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-e907e4-654594658b-fw8n2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-e907e4-654594658b-fw8n2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-e907e4-654594658b-fw8n2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-e907e4-654594658b-fw8n2

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4f2325

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4f2325-9b997dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4f2325-849994d776

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4f2325-849994d776-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4f2325: serviceaccount "payload-processing-e2e-ipp-a-4f2325" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4f2325

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4f2325-849994d776 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4f2325-849994d776

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4f2325-849994d776-qf6ph
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4f2325-9b997dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4f2325-9b997dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4f2325: serviceaccount "payload-processing-e2e-ipp-a-4f2325" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4f2325-9b997dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4f2325-9b997dc-d2jsf

openshift-ingress

gateway_labeler_controller

e2e-api-b-2beb7b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2beb7b

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4f2325-9b997dc-d2jsf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4f2325-849994d776-qf6ph

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-2beb7b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2beb7b-openshift-default-9df6554f9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4f2325-9b997dc-d2jsf

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4f2325-9b997dc-d2jsf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-4f2325-849994d776-qf6ph

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-2beb7b-openshift-default-9df6554f9

SuccessfulCreate

Created pod: e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4f2325-9b997dc-d2jsf

Started

Container started

openshift-ingress

multus

e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4f2325-849994d776-qf6ph

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4f2325-849994d776-qf6ph

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-59e21a-849b8bbd95-82slf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-59e21a-75b5d75c8d-rbx6t

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2beb7b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2beb7b-5bbfdfc944 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2beb7b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479-5cpxb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479-5cpxb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2beb7b: serviceaccount "payload-processing-e2e-api-b-2beb7b" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-2beb7b-5bbfdfc944-hmv9l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-2beb7b-5bbfdfc944-hmv9l

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-2beb7b-5bbfdfc944-hmv9l

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2beb7b-5bbfdfc944

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2beb7b-5bbfdfc944-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2beb7b: serviceaccount "payload-processing-e2e-api-b-2beb7b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2beb7b-5bbfdfc944

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2beb7b-5bbfdfc944-hmv9l

openshift-ingress

kubelet

payload-processing-e2e-api-b-2beb7b-5bbfdfc944-hmv9l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479-5cpxb

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479-5cpxb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479-5cpxb

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-913351-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-913351-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-59e21a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-59e21a-7b48b6cc86 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-59e21a: serviceaccount "payload-processing-e2e-ipp-b-59e21a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-59e21a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95-kqkp8
(x2)

openshift-ingress

kubelet

e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-59e21a-7b48b6cc86

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-59e21a-7b48b6cc86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-59e21a: serviceaccount "payload-processing-e2e-ipp-b-59e21a" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2beb7b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-59e21a-7b48b6cc86

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-59e21a-7b48b6cc86-8r4tc

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95-kqkp8

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95-kqkp8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2beb7b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-59e21a-7b48b6cc86-8r4tc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95-kqkp8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-59e21a-7b48b6cc86-8r4tc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-59e21a-7b48b6cc86-8r4tc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95-kqkp8

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-59e21a-7b48b6cc86-8r4tc

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

Unhealthy

Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

ProbeError

Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-040623-577cc456d-sf9nq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-040623-5f54648f55-hx52g

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c9d69c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-59e21a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-59e21a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c9d69c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-api-b-f61e4b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f61e4b-openshift-default-787f77d447 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-f61e4b-openshift-default-787f77d447

SuccessfulCreate

Created pod: e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

openshift-ingress

gateway_labeler_controller

e2e-api-b-f61e4b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f61e4b

openshift-ingress

multus

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-e907e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e907e4-openshift-default-5565b5d845 from 1 to 2

openshift-ingress

multus

e2e-api-a-e907e4-openshift-default-5565b5d845-799mq

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e907e4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-e907e4-openshift-default-5565b5d845

SuccessfulCreate

Created pod: e2e-api-a-e907e4-openshift-default-5565b5d845-799mq

openshift-ingress

kubelet

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

Unhealthy

Readiness probe failed: Get "http://10.132.0.128:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-799mq

Started

Container started

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-799mq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

ProbeError

Readiness probe error: Get "http://10.132.0.128:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-799mq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4f2325-9b997dc-d2jsf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4f2325-849994d776-qf6ph

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f61e4b: serviceaccount "payload-processing-e2e-api-b-f61e4b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f61e4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f61e4b-66959bc884 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

Unhealthy

Readiness probe failed: Get "http://10.132.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f61e4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f61e4b-66959bc884

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f61e4b-66959bc884-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f61e4b: serviceaccount "payload-processing-e2e-api-b-f61e4b" not found

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

ProbeError

Readiness probe error: Get "http://10.132.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5-gv9x9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-f61e4b-66959bc884-hmnz9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-f61e4b-66959bc884-hmnz9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-f61e4b-66959bc884-hmnz9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-f61e4b-66959bc884-hmnz9

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5-gv9x9

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5-gv9x9

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5-gv9x9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5-gv9x9

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f61e4b-66959bc884

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f61e4b-66959bc884-hmnz9
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4f2325-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4f2325-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-040623

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-040623-86f6f98d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-040623-6db97689bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-040623-6db97689bc-rh2kf

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-040623-86f6f98d86

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-040623-86f6f98d86-5pp5q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-040623

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-040623-6db97689bc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-799mq

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-799mq

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-040623-86f6f98d86

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-040623-86f6f98d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-040623: serviceaccount "payload-processing-e2e-ipp-b-040623" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-040623-6db97689bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-040623-6db97689bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-040623: serviceaccount "payload-processing-e2e-ipp-b-040623" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-040623-6db97689bc-rh2kf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-040623-6db97689bc-rh2kf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-040623-86f6f98d86-5pp5q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-040623-86f6f98d86-5pp5q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-040623-86f6f98d86-5pp5q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-040623-6db97689bc-rh2kf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-040623-86f6f98d86-5pp5q

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-040623-6db97689bc-rh2kf

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-040623-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-040623-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

ProbeError

Startup probe error: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

Unhealthy

Startup probe failed: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e907e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e907e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4f2325: serviceaccount "payload-processing-e2e-ipp-a-4f2325" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4f2325

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4f2325-74f4586c46 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4f2325

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c-k9h2j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4f2325-74f4586c46

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4f2325-74f4586c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4f2325: serviceaccount "payload-processing-e2e-ipp-a-4f2325" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4f2325-74f4586c46

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4f2325-74f4586c46-k8dqc

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c-k9h2j

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c-k9h2j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c-k9h2j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4f2325-74f4586c46-k8dqc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4f2325-74f4586c46-k8dqc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-4f2325-74f4586c46-k8dqc

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c-k9h2j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4f2325-74f4586c46-k8dqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1e3723-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1e3723-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e3723-5b496fc79f-r2slx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e3723-7664ccccb4-tl8pc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-59e21a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-59e21a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e907e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e907e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ec5e0f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ec5e0f

openshift-ingress

replicaset-controller

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf

SuccessfulCreate

Created pod: e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn

openshift-ingress

deployment-controller

e2e-ipp-b-ec5e0f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf from 0 to 1

openshift-ingress

multus

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4f2325-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4f2325-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ec5e0f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ec5e0f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ec5e0f: serviceaccount "payload-processing-e2e-ipp-b-ec5e0f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ec5e0f: serviceaccount "payload-processing-e2e-ipp-b-ec5e0f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b-p4gs4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7-cvnn6

openshift-ingress

multus

payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b-p4gs4

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b-p4gs4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b-p4gs4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7-cvnn6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7-cvnn6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7-cvnn6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b-p4gs4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7-cvnn6

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-040623-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-040623-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c9d69c-588d68c4db-d9d4q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c9d69c-7ff6dbc9c9-8v6rk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-2a3e1b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7

SuccessfulDelete

Deleted pod: e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-bw7h8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-2a3e1b-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-api-a-e907e4-654594658b-fw8n2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e907e4-64d884bb9f-2cp6w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-lvsnp

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-wcbh8
(x2)

openshift-ingress

kubelet

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-c9d69c-openshift-default-7cf99b5679-x8svx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-e907e4-654594658b-fw8n2

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.131:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f61e4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f61e4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2beb7b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2beb7b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-67dtx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-2qpx2

openshift-ingress

kubelet

e2e-api-a-1e3723-openshift-default-6fd569f6bc-7j6rc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-913351-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-913351-openshift-default-579dcdf795

SuccessfulCreate

Created pod: e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

openshift-ingress

deployment-controller

e2e-ipp-a-913351-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-913351-openshift-default-579dcdf795 from 1 to 2

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

Started

Container started

openshift-ingress

multus

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-040623-6db97689bc-rh2kf

Unhealthy

Readiness probe failed: dial tcp 10.133.0.104:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-040623-6db97689bc-rh2kf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-040623-86f6f98d86-5pp5q

Unhealthy

Readiness probe failed: dial tcp 10.133.0.105:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-040623-86f6f98d86-5pp5q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2beb7b-5bbfdfc944-hmv9l

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2beb7b-6f9c4fb479-5cpxb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-mg64k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-qdtdt
(x6)

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

Unhealthy

Startup probe failed: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

ProbeError

Startup probe error: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ec5e0f-78c8f75f4b-p4gs4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ec5e0f-695bcb6dd7-cvnn6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2beb7b-5bbfdfc944-hmv9l

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.133:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf

SuccessfulCreate

Created pod: e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ec5e0f-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf

SuccessfulCreate

Created pod: e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl

openshift-ingress

replicaset-controller

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf

SuccessfulCreate

Created pod: e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8

openshift-ingress

deployment-controller

e2e-ipp-b-ec5e0f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf from 1 to 4

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8

Started

Container started

openshift-ingress

multus

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6

Created

Container created

openshift-ingress

multus

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-040623-openshift-default-74b5f7d8d7-q8p6t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-b17e94-openshift-default-666cf59769

SuccessfulCreate

Created pod: e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

openshift-ingress

deployment-controller

e2e-praxis-a-b17e94-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b17e94-openshift-default-666cf59769 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-b17e94

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-b17e94

openshift-ingress

multus

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-799mq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-e907e4-openshift-default-5565b5d845-x8n49

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ec5e0f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f61e4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ec5e0f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ec5e0f: serviceaccount "payload-processing-e2e-ipp-b-ec5e0f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-g74ff
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f61e4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b-5h64l
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ec5e0f: serviceaccount "payload-processing-e2e-ipp-b-ec5e0f" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b-5h64l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-g74ff

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-g74ff

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b-5h64l

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-g74ff

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-g74ff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b-5h64l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b-5h64l

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b17e94-b96ddfb96

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-b17e94-b96ddfb96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b17e94: serviceaccount "payload-processing-e2e-praxis-a-b17e94" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-xfbnc

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-b17e94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-b17e94-b96ddfb96 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b17e94-b96ddfb96

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-b17e94-b96ddfb96-9dkqk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-b17e94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b17e94: serviceaccount "payload-processing-e2e-praxis-a-b17e94" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b17e94-b96ddfb96-9dkqk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b17e94-b96ddfb96-9dkqk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-xfbnc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-b17e94-b96ddfb96-9dkqk

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-xfbnc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b17e94-b96ddfb96-9dkqk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-xfbnc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-xfbnc

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ec5e0f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ec5e0f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-f61e4b-66959bc884-hmnz9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f61e4b-7c54c4f9f5-gv9x9

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ec5e0f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ec5e0f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-2beb7b-openshift-default-9df6554f9-hknkk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-490cdf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-490cdf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-490cdf

openshift-ingress

replicaset-controller

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc

SuccessfulCreate

Created pod: e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

openshift-ingress

multus

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-490cdf-6d869df5dd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-490cdf-6d869df5dd-kqf6m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-490cdf-6d869df5dd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-490cdf-6d869df5dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-490cdf: serviceaccount "payload-processing-e2e-praxis-a-490cdf" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-490cdf: serviceaccount "payload-processing-e2e-praxis-a-490cdf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-490cdf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-490cdf-6d869df5dd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547-b8s7z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-490cdf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-490cdf-6d869df5dd-kqf6m

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547-b8s7z

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-490cdf-6d869df5dd-kqf6m

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-490cdf-6d869df5dd-kqf6m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-490cdf-6d869df5dd-kqf6m

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-f03120

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f03120

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547-b8s7z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-b-f03120-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f03120-openshift-default-6c67ff9d5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-f03120-openshift-default-6c67ff9d5c

SuccessfulCreate

Created pod: e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547-b8s7z

Started

Container started

openshift-ingress

multus

e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547-b8s7z

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-f03120

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-f03120-79bf49bdd6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9-vj88z

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9-vj88z

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-f03120

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9-vj88z
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f03120: serviceaccount "payload-processing-e2e-praxis-b-f03120" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9-vj88z

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f03120-79bf49bdd6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-f03120-79bf49bdd6-z9zzs

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9-vj88z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f03120-79bf49bdd6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-f03120-79bf49bdd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f03120: serviceaccount "payload-processing-e2e-praxis-b-f03120" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-f03120-79bf49bdd6-z9zzs

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f03120-79bf49bdd6-z9zzs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f03120-79bf49bdd6-z9zzs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f03120-79bf49bdd6-z9zzs

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b17e94-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b17e94-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

Unhealthy

Readiness probe failed: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

ProbeError

Readiness probe error: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-426bab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-426bab

openshift-ingress

deployment-controller

e2e-ipp-a-426bab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-426bab-openshift-default-55bc58fb6f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4f2325-74f4586c46-k8dqc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4f2325-7cc7c79d6c-k9h2j

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-426bab-openshift-default-55bc58fb6f

SuccessfulCreate

Created pod: e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-f61e4b-openshift-default-787f77d447-5dkcj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-913351-5fdf8855f8-cmg2s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-913351-69b8cfd859-pv667

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-913351

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-913351: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-913351": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-913351, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 76226824-b332-4a24-8bda-dd85ad3fb09c, UID in object meta:

openshift-ingress

multus

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-426bab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-426bab-659f447667 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-426bab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-426bab-7c4d75cb74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-426bab-659f447667

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-426bab-659f447667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-426bab: serviceaccount "payload-processing-e2e-ipp-a-426bab" not found
(x2)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-426bab-7c4d75cb74

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-426bab-7c4d75cb74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-426bab: serviceaccount "payload-processing-e2e-ipp-a-426bab" not found
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-426bab-659f447667-7fkg4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-426bab-659f447667-7fkg4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-426bab-659f447667

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-426bab-659f447667-7fkg4

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-426bab-7c4d75cb74

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-426bab-7c4d75cb74-6v8gn

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-426bab-659f447667-7fkg4

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-426bab-659f447667-7fkg4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-426bab-7c4d75cb74-6v8gn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-426bab-7c4d75cb74-6v8gn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-426bab-7c4d75cb74-6v8gn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-426bab-7c4d75cb74-6v8gn

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-490cdf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-490cdf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-b-ee4af9-openshift-default-597677545c

SuccessfulCreate

Created pod: e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj

openshift-ingress

kubelet

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-4f2325-openshift-default-8569d95fc5-sz2sq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-praxis-b-ee4af9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ee4af9-openshift-default-597677545c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ee4af9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ee4af9

openshift-ingress

multus

e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ee4af9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ee4af9: serviceaccount "payload-processing-e2e-praxis-b-ee4af9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ee4af9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ee4af9: serviceaccount "payload-processing-e2e-praxis-b-ee4af9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6-bcw9b

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f-zw8j8

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f-zw8j8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6-bcw9b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f-zw8j8

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6-bcw9b

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f-zw8j8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6-bcw9b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f-zw8j8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6-bcw9b

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b17e94-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ec5e0f-6744b4d9b-5h64l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-g74ff

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b17e94-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulDelete

Deleted pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 9 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulDelete

Deleted pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-k4ppk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-pd9zt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ec5e0f-7d456d9f7f-g74ff

Unhealthy

Readiness probe failed: dial tcp 10.132.0.147:9004: i/o timeout

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

ProbeError

Readiness probe error: Get "http://10.132.0.153:15021/healthz/ready": read tcp 10.132.0.2:43630->10.132.0.153:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

Unhealthy

Readiness probe failed: Get "http://10.132.0.153:15021/healthz/ready": read tcp 10.132.0.2:43630->10.132.0.153:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f03120-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f03120-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-cn9k8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-57lgn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-x8csl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-ec5e0f-openshift-default-c6576c9bf-hw4t6

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd

ProbeError

Startup probe error: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

ProbeError

Startup probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd

Unhealthy

Startup probe failed: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

Unhealthy

Startup probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-426bab-7c4d75cb74-6v8gn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-426bab-659f447667-7fkg4

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-426bab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-426bab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f03120-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f03120-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-426bab-c67495f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-426bab-c67495f5-4mq9r
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-426bab-c67495f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-426bab-c67495f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-426bab: serviceaccount "payload-processing-e2e-ipp-a-426bab" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-426bab-759c7cdb9b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-426bab-759c7cdb9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-426bab: serviceaccount "payload-processing-e2e-ipp-a-426bab" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-426bab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-426bab-c67495f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-426bab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-426bab-759c7cdb9b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-426bab-759c7cdb9b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-426bab-759c7cdb9b-x2s72

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-426bab-c67495f5-4mq9r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-426bab-759c7cdb9b-x2s72

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-426bab-c67495f5-4mq9r

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-426bab-c67495f5-4mq9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-426bab-c67495f5-4mq9r

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-426bab-759c7cdb9b-x2s72

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-426bab-759c7cdb9b-x2s72

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-426bab-759c7cdb9b-x2s72

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-xcgmf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-913351-openshift-default-579dcdf795-lv42f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ee4af9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ee4af9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-490cdf-6d869df5dd-kqf6m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-490cdf-6cf955d547-b8s7z

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-55a8e6-openshift-default-dccc759cc

SuccessfulCreate

Created pod: e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-55a8e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-55a8e6

openshift-ingress

deployment-controller

e2e-ipp-b-55a8e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-55a8e6-openshift-default-dccc759cc from 0 to 1

openshift-ingress

multus

e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-55a8e6: serviceaccount "payload-processing-e2e-ipp-b-55a8e6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-55a8e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-55a8e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc-2vzn5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-55a8e6: serviceaccount "payload-processing-e2e-ipp-b-55a8e6" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b-b4gww

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-b17e94-openshift-default-666cf59769

SuccessfulCreate

Created pod: e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc-2vzn5

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc-2vzn5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b-b4gww

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc-2vzn5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc-2vzn5

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-a-b17e94-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b17e94-openshift-default-666cf59769 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b17e94-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b-b4gww

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b-b4gww

Created

Container created

openshift-ingress

multus

e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b-b4gww

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-490cdf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-490cdf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz

Unhealthy

Startup probe failed: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ee4af9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ee4af9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-426bab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-426bab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz

ProbeError

Startup probe error: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-490cdf-openshift-default-7dd4bb56cc-v5vdd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-59e21a-688fbf8b95-kqkp8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-59e21a-7b48b6cc86-8r4tc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ee4af9-7fd89f99b6-bcw9b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ee4af9-57577b479f-zw8j8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-59e21a-openshift-default-5ddffb659-j8rjj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-d2dd78-openshift-default-7548dd44b9

SuccessfulCreate

Created pod: e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-d2dd78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-d2dd78

openshift-ingress

deployment-controller

e2e-praxis-a-d2dd78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d2dd78-openshift-default-7548dd44b9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-55a8e6-5f9b84f74b-b4gww

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-55a8e6-76f98dcfdc-2vzn5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulCreate

Created pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 8 to 10

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-d2dd78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-d2dd78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

Created

Container created

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8-d8qxp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d2dd78: serviceaccount "payload-processing-e2e-praxis-a-d2dd78" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d2dd78: serviceaccount "payload-processing-e2e-praxis-a-d2dd78" not found

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f-59v4h

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8-d8qxp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8-d8qxp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8-d8qxp

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f-59v4h

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f-59v4h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f-59v4h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f-59v4h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8-d8qxp

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-55a8e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-55a8e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-55a8e6-5c95d4c796 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c-m2tkx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-55a8e6-5c95d4c796

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-55a8e6-5c95d4c796-pzh5w
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-55a8e6-5c95d4c796

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-55a8e6-5c95d4c796-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-55a8e6: serviceaccount "payload-processing-e2e-ipp-b-55a8e6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-55a8e6: serviceaccount "payload-processing-e2e-ipp-b-55a8e6" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c-m2tkx

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c-m2tkx

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-55a8e6-5c95d4c796-pzh5w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-55a8e6-5c95d4c796-pzh5w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-55a8e6-5c95d4c796-pzh5w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c-m2tkx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c-m2tkx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-55a8e6-5c95d4c796-pzh5w

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

Unhealthy

Startup probe failed: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

ProbeError

Startup probe error: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-ee4af9-openshift-default-597677545c-6mjvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sbbjg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-sbbjg
(x2)

openshift-ingress

kubelet

e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-xfbnc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b17e94-b96ddfb96-9dkqk

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth

ProbeError

Startup probe error: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth

Unhealthy

Startup probe failed: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-praxis-b-a29f33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-a29f33-openshift-default-5b4bcc765 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-a29f33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-a29f33

openshift-ingress

replicaset-controller

e2e-praxis-b-a29f33-openshift-default-5b4bcc765

SuccessfulCreate

Created pod: e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

openshift-ingress

multus

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6x4v2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c-ntf8l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-a29f33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a29f33: serviceaccount "payload-processing-e2e-praxis-b-a29f33" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a29f33-5ffb5696f4

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-a29f33-5ffb5696f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a29f33: serviceaccount "payload-processing-e2e-praxis-b-a29f33" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-a29f33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-a29f33-5ffb5696f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a29f33-5ffb5696f4

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-a29f33-5ffb5696f4-v88tb

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c-ntf8l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-426bab-759c7cdb9b-x2s72

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-praxis-b-a29f33-5ffb5696f4-v88tb

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a29f33-5ffb5696f4-v88tb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c-ntf8l

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a29f33-5ffb5696f4-v88tb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a29f33-5ffb5696f4-v88tb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-426bab-c67495f5-4mq9r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c-ntf8l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c-ntf8l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-426bab-c67495f5-4mq9r

Unhealthy

Readiness probe failed: dial tcp 10.132.0.165:9004: i/o timeout
(x3)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b17e94-b96ddfb96-9dkqk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b17e94-64ccdf6bb7-xfbnc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-55a8e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-55a8e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulCreate

Created pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

Started

Container started

openshift-ingress

multus

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-2a3e1b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7 from 4 to 3
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7

SuccessfulDelete

Deleted pod: e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-8rtvs

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-2a3e1b-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 8 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d2dd78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-j9sq4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

Unhealthy

Readiness probe failed: Get "http://10.132.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-2r2jg
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d2dd78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-426bab-openshift-default-55bc58fb6f-7kkfk

ProbeError

Readiness probe error: Get "http://10.132.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulDelete

Deleted pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-2prq4
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj

Unhealthy

Startup probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

Unhealthy

Startup probe failed: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj

ProbeError

Startup probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

ProbeError

Startup probe error: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 9 to 7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-ldmb6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-9lwvc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-55a8e6-84d4644b6c-m2tkx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-55a8e6-5c95d4c796-pzh5w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

Unhealthy

Readiness probe failed: Get "http://10.132.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

ProbeError

Readiness probe error: Get "http://10.132.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d2dd78-7ff77c445f-59v4h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-55a8e6-openshift-default-dccc759cc-hswth

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d2dd78-5ffbd744f8-d8qxp

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-praxis-a-927bf8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-927bf8-openshift-default-6fd9c579c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-927bf8-openshift-default-6fd9c579c

SuccessfulCreate

Created pod: e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-927bf8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-927bf8
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

Unhealthy

Readiness probe failed: Get "http://10.132.0.187:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

ProbeError

Readiness probe error: Get "http://10.132.0.187:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc-gkfmx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-927bf8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-927bf8: serviceaccount "payload-processing-e2e-praxis-a-927bf8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-927bf8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-927bf8-6df68dcfdd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-927bf8-6df68dcfdd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-927bf8-6df68dcfdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-927bf8: serviceaccount "payload-processing-e2e-praxis-a-927bf8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-927bf8-6df68dcfdd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-927bf8-6df68dcfdd-6rppj

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc-gkfmx

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc-gkfmx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 6 to 5
(x5)

openshift-ingress

kubelet

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

ProbeError

Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d2dd78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d2dd78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-hvgd9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc-gkfmx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc-gkfmx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-927bf8-6df68dcfdd-6rppj

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

Unhealthy

Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-927bf8-6df68dcfdd-6rppj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-927bf8-6df68dcfdd-6rppj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-927bf8-6df68dcfdd-6rppj

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a29f33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a29f33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x16)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x3)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Unhealthy

Liveness probe failed: Get "https://10.132.0.50:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-d2dd78-openshift-default-7548dd44b9-sxjvf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-vhjfz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b17e94-openshift-default-666cf59769-nb98l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a29f33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a29f33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a29f33-5ffb5696f4-v88tb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a29f33-b5dddf8c-ntf8l

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-praxis-b-c1768b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c1768b-openshift-default-567bf88dc7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-c1768b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-c1768b

openshift-ingress

replicaset-controller

e2e-praxis-b-c1768b-openshift-default-567bf88dc7

SuccessfulCreate

Created pod: e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

openshift-ingress

multus

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-c1768b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-c1768b-7784fb67fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885

SuccessfulCreate

Created pod: e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

openshift-ingress

deployment-controller

e2e-shared-a-w2-b24a1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9

SuccessfulCreate

Created pod: e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

openshift-ingress

deployment-controller

e2e-shared-a-w3-0eeba5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-0eeba5-openshift-default-7f66686885 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-c1768b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-b24a1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-b24a1a
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c1768b: serviceaccount "payload-processing-e2e-praxis-b-c1768b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667-94d6v

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-0eeba5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-0eeba5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c1768b-7784fb67fb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-c1768b-7784fb67fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c1768b: serviceaccount "payload-processing-e2e-praxis-b-c1768b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c1768b-7784fb67fb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-c1768b-7784fb67fb-jnzk6

openshift-ingress

multus

payload-processing-e2e-praxis-b-c1768b-7784fb67fb-jnzk6

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667-94d6v

Created

Container created

openshift-ingress

multus

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667-94d6v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c1768b-7784fb67fb-jnzk6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f03120-7b689f64f9-vj88z

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667-94d6v

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c1768b-7784fb67fb-jnzk6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667-94d6v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c1768b-7784fb67fb-jnzk6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f03120-79bf49bdd6-z9zzs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-b-a29f33-openshift-default-5b4bcc765-c6gm2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-0eeba5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-0eeba5-75c6455594 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-ggxvs

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-s84hv

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b24a1a: serviceaccount "payload-processing-e2e-shared-a-w2-b24a1a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b24a1a: serviceaccount "payload-processing-e2e-shared-a-w2-b24a1a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-s84hv

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-b24a1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-0eeba5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-ggxvs

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-b24a1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0eeba5-75c6455594-8kbxt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595-9xplz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-s84hv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595-9xplz

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0eeba5: serviceaccount "payload-processing-e2e-shared-a-w3-0eeba5" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0eeba5-75c6455594-8kbxt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0eeba5-75c6455594-8kbxt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595-9xplz

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0eeba5-75c6455594

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-0eeba5-75c6455594-8kbxt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0eeba5-75c6455594

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-0eeba5-75c6455594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0eeba5: serviceaccount "payload-processing-e2e-shared-a-w3-0eeba5" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-s84hv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595-9xplz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-0eeba5-75c6455594-8kbxt

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-ggxvs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-ggxvs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-s84hv

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595-9xplz

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-ggxvs

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

Unhealthy

Readiness probe failed: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

ProbeError

Readiness probe error: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-f03120-openshift-default-6c67ff9d5c-gxmtd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c

SuccessfulCreate

Created pod: e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-b7431c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-b7431c

openshift-ingress

deployment-controller

e2e-shared-a-w4-b7431c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-927bf8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-927bf8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-b7431c: serviceaccount "payload-processing-e2e-shared-a-w4-b7431c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-b7431c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-qnsqx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-b7431c: serviceaccount "payload-processing-e2e-shared-a-w4-b7431c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-t5hh5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-b7431c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-t5hh5

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kkzgw

Unhealthy

Readiness probe failed: Get "https://10.132.0.47:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0eeba5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-cs6bc

Unhealthy

Readiness probe failed: Get "https://10.132.0.49:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-t5hh5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0eeba5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-t5hh5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-qnsqx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-qnsqx

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-qnsqx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-t5hh5

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-a-w1-7eaeed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-qnsqx

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-7eaeed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-7eaeed

openshift-ingress

replicaset-controller

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79

SuccessfulCreate

Created pod: e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

openshift-ingress

multus

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-54d4c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-54d4c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-54d4c4

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-927bf8-6df68dcfdd-6rppj

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-779fa3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-779fa3

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

Unhealthy

Readiness probe failed: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

ProbeError

Readiness probe error: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45

SuccessfulCreate

Created pod: e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq

openshift-ingress

deployment-controller

e2e-shared-b-w3-779fa3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-779fa3-openshift-default-b556b9b45 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-927bf8-9fb9d59bc-gkfmx

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7

SuccessfulCreate

Created pod: e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-7eaeed: serviceaccount "payload-processing-e2e-shared-a-w1-7eaeed" not found

openshift-ingress

multus

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-7eaeed: serviceaccount "payload-processing-e2e-shared-a-w1-7eaeed" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-7eaeed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-rs668

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-7eaeed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-8q54p

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-8q54p

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-8q54p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-rs668

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-8q54p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-rs668

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-rs668

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-8q54p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-927bf8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-927bf8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-rs668

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-54d4c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-779fa3: serviceaccount "payload-processing-e2e-shared-b-w3-779fa3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-779fa3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-779fa3: serviceaccount "payload-processing-e2e-shared-b-w3-779fa3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-54d4c4: serviceaccount "payload-processing-e2e-shared-b-w2-54d4c4" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-54d4c4: serviceaccount "payload-processing-e2e-shared-b-w2-54d4c4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff-hzg9q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff-hzg9q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-54d4c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff-hzg9q

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-779fa3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff-hzg9q

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff-hzg9q

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674-jvq68

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-z8lw8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674-jvq68

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-z8lw8

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-59tph

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-59tph

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674-jvq68

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-59tph

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-z8lw8

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-59tph

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674-jvq68

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-z8lw8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-59tph

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674-jvq68

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-z8lw8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-b24a1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-b24a1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

Unhealthy

Startup probe failed: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

ProbeError

Startup probe error: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

ProbeError

Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

Unhealthy

Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-927bf8-openshift-default-6fd9c579c-8ljrz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c1768b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w4-7cbcbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-7cbcbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-7cbcbb

openshift-ingress

replicaset-controller

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9

SuccessfulCreate

Created pod: e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c1768b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-7cbcbb: serviceaccount "payload-processing-e2e-shared-b-w4-7cbcbb" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-7cbcbb: serviceaccount "payload-processing-e2e-shared-b-w4-7cbcbb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-7cbcbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-7cbcbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-q8vd4

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c1768b-5dd5d79667-94d6v

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-hwx2w

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-q8vd4

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c1768b-7784fb67fb-jnzk6

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-hwx2w

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-hwx2w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-hwx2w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-hwx2w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-q8vd4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-q8vd4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-q8vd4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

ProbeError

Readiness probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

Unhealthy

Readiness probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w1-981ee5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c

SuccessfulCreate

Created pod: e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-981ee5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-981ee5

openshift-ingress

multus

e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c1768b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c1768b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-bxr9v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-981ee5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-981ee5: serviceaccount "payload-processing-e2e-shared-b-w1-981ee5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-vpm56

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-981ee5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-981ee5: serviceaccount "payload-processing-e2e-shared-b-w1-981ee5" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-bxr9v

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-bxr9v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-bxr9v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-vpm56

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-vpm56

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-vpm56

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-bxr9v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-vpm56

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-b24a1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-b24a1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-c1768b-openshift-default-567bf88dc7-cqntz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-b7431c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-b7431c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7cbcbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7cbcbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-54d4c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-779fa3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-54d4c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-779fa3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

Unhealthy

Startup probe failed: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

ProbeError

Startup probe error: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

ProbeError

Startup probe error: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

Unhealthy

Startup probe failed: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq

Unhealthy

Startup probe failed: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq

ProbeError

Startup probe error: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-explicit-f0e884

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f0e884

openshift-ingress

replicaset-controller

e2e-explicit-f0e884-openshift-default-6474bdb5df

SuccessfulCreate

Created pod: e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

openshift-ingress

deployment-controller

e2e-explicit-f0e884-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f0e884-openshift-default-6474bdb5df from 0 to 1

openshift-ingress

multus

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7eaeed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0eeba5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0eeba5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7eaeed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulDelete

Deleted pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-4ghff

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f0e884-b8df455b8

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f0e884-b8df455b8-wb58x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f0e884

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f0e884-9f9499899 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f0e884

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f0e884-b8df455b8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f0e884-9f9499899

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f0e884-9f9499899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f0e884: serviceaccount "payload-processing-e2e-explicit-f0e884" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-b7431c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-b7431c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f0e884-b8df455b8

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f0e884-b8df455b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f0e884: serviceaccount "payload-processing-e2e-explicit-f0e884" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f0e884-9f9499899

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f0e884-9f9499899-rlbsw

openshift-ingress

kubelet

payload-processing-e2e-explicit-f0e884-b8df455b8-wb58x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-f0e884-b8df455b8-wb58x

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-779fa3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f0e884-9f9499899-rlbsw

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f0e884-9f9499899-rlbsw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f0e884-9f9499899-rlbsw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f0e884-9f9499899-rlbsw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-f0e884-b8df455b8-wb58x

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-779fa3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-explicit-f0e884-b8df455b8-wb58x

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7eaeed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7eaeed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulDelete

Deleted pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6l2jm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 5 to 4

openshift-ingress

deployment-controller

e2e-shared-b-w3-779fa3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-779fa3-openshift-default-b556b9b45 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-779fa3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45

SuccessfulCreate

Created pod: e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

Started

Container started

openshift-ingress

multus

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9

SuccessfulCreate

Created pod: e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

openshift-ingress

deployment-controller

e2e-shared-a-w2-b24a1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-b24a1a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulCreate

Created pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885

SuccessfulCreate

Created pod: e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0eeba5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w3-0eeba5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-0eeba5-openshift-default-7f66686885 from 1 to 2

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

AddedInterface

Add eth0 [10.132.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

Started

Container started

openshift-ingress

multus

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

Created

Container created

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

Started

Container started

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

AddedInterface

Add eth0 [10.132.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

Started

Container started

openshift-ingress

multus

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-54d4c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-54d4c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x11)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

ProbeError

Startup probe error: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

Unhealthy

Startup probe failed: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x11)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

ProbeError

Startup probe error: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

Unhealthy

Startup probe failed: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x11)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

Unhealthy

Startup probe failed: Get "http://10.132.0.231:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

ProbeError

Startup probe error: Get "http://10.132.0.231:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-explicit-f0e884-openshift-default-6474bdb5df

SuccessfulCreate

Created pod: e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

Started

Container started

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

Created

Container created

openshift-ingress

deployment-controller

e2e-explicit-f0e884-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f0e884-openshift-default-6474bdb5df from 1 to 2

openshift-ingress

multus

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-f0e884-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

Created

Container created

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

ProbeError

Readiness probe error: Get "http://10.132.0.226:15021/healthz/ready": read tcp 10.132.0.2:60764->10.132.0.226:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

Unhealthy

Readiness probe failed: Get "http://10.132.0.226:15021/healthz/ready": read tcp 10.132.0.2:60764->10.132.0.226:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-2rj4k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-2rj4k
(x6)

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 7 to 6
(x6)

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

Unhealthy

Startup probe failed: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

ProbeError

Startup probe error: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-f0e884-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-f0e884-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f0e884-9f9499899-rlbsw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f0e884-b8df455b8-wb58x

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-f0e884-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-f0e884-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-981ee5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-981ee5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv

Unhealthy

Startup probe failed: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv

ProbeError

Startup probe error: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f

Unhealthy

Startup probe failed: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f

ProbeError

Startup probe error: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-4hzcn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-8fdea8-openshift-default-98d979769-skktq

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-8fdea8-openshift-default-98d979769

SuccessfulCreate

Created pod: e2e-noten-8fdea8-openshift-default-98d979769-skktq

openshift-ingress

deployment-controller

e2e-noten-8fdea8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-8fdea8-openshift-default-98d979769 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-8fdea8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-8fdea8

openshift-ingress

kubelet

e2e-noten-8fdea8-openshift-default-98d979769-skktq

Created

Container created

openshift-ingress

kubelet

e2e-noten-8fdea8-openshift-default-98d979769-skktq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-8fdea8-openshift-default-98d979769-skktq

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-981ee5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-981ee5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

ProbeError

Readiness probe error: Get "http://10.134.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-f0e884-openshift-default-6474bdb5df-877z8

Unhealthy

Readiness probe failed: Get "http://10.134.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7

SuccessfulDelete

Deleted pod: e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-b6qfw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-2a3e1b-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-2a3e1b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7 from 3 to 2

openshift-ingress

kubelet

e2e-noten-8fdea8-openshift-default-98d979769-skktq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-8fdea8-openshift-default-98d979769-skktq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-8fdea8-openshift-default-98d979769-skktq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7cbcbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7cbcbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7325-14a184

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7325-14a184

AddedInterface

Add eth0 [10.132.0.245/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-14a184

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.962s (2.962s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7325-14a184

Started

Container started

opendatahub

kubelet

test-curl-7325-14a184

Created

Container created

opendatahub

kubelet

test-curl-7325-2b3c41

Created

Container created

opendatahub

kubelet

test-curl-7325-2b3c41

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7325-2b3c41

Started

Container started

opendatahub

multus

test-curl-7325-2b3c41

AddedInterface

Add eth0 [10.132.0.246/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-14a184

Killing

Stopping container test-curl-7325-14a184

openshift-ingress

replicaset-controller

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f

SuccessfulCreate

Created pod: e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

opendatahub

kubelet

test-curl-7325-2b3c41

Killing

Stopping container test-curl-7325-2b3c41

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-4d2317

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-4d2317

openshift-ingress

deployment-controller

e2e-shared-a-w0-4d2317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

AddedInterface

Add eth0 [10.132.0.248/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-4d2317

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5-mzsbd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5-mzsbd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5-mzsbd

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-a-w1-7eaeed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79 from 1 to 2

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5-mzsbd

AddedInterface

Add eth0 [10.132.0.249/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79

SuccessfulCreate

Created pod: e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7eaeed-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4-4784l

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4-4784l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4-4784l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4-4784l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5-mzsbd

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-4d2317: serviceaccount "payload-processing-e2e-shared-a-w0-4d2317" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4-4784l
(x2)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-4d2317: serviceaccount "payload-processing-e2e-shared-a-w0-4d2317" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-4d2317

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

Started

Container started

openshift-ingress

multus

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

ProbeError

Startup probe error: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

Unhealthy

Startup probe failed: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused

opendatahub

kubelet

test-curl-7334-54897d

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7334-54897d

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7334-54897d

Started

Container started

opendatahub

kubelet

test-curl-7334-54897d

Created

Container created

opendatahub

kubelet

test-curl-7334-54897d

Killing

Stopping container test-curl-7334-54897d

opendatahub

multus

test-curl-7334-1b6145

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7334-1b6145

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7334-1b6145

Created

Container created

opendatahub

kubelet

test-curl-7334-1b6145

Started

Container started

opendatahub

kubelet

test-curl-7334-1b6145

Killing

Stopping container test-curl-7334-1b6145

opendatahub

kubelet

test-curl-7334-2c1f58

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7334-2c1f58

Started

Container started

opendatahub

kubelet

test-curl-7334-2c1f58

Created

Container created

opendatahub

multus

test-curl-7334-2c1f58

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes

opendatahub

multus

test-curl-7334-68df11

AddedInterface

Add eth0 [10.132.0.254/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7334-68df11

Started

Container started

opendatahub

kubelet

test-curl-7334-68df11

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7334-68df11

Created

Container created

opendatahub

kubelet

test-curl-7334-2c1f58

Killing

Stopping container test-curl-7334-2c1f58

opendatahub

kubelet

test-curl-7334-68df11

Killing

Stopping container test-curl-7334-68df11

openshift-ingress

replicaset-controller

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5

SuccessfulCreate

Created pod: e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-c9bce8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-c9bce8

openshift-ingress

deployment-controller

e2e-extmod-a-c9bce8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w0-75b361-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-75b361-openshift-default-d779c697c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-75b361-openshift-default-d779c697c

SuccessfulCreate

Created pod: e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-75b361

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-75b361

openshift-ingress

multus

e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

AddedInterface

Add eth0 [10.132.1.0/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-c9bce8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-c9bce8-6b8df985dd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c9bce8-6b8df985dd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c9bce8: serviceaccount "payload-processing-e2e-extmod-a-c9bce8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-c9bce8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c9bce8: serviceaccount "payload-processing-e2e-extmod-a-c9bce8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c9bce8-6b8df985dd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-75fgg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-9845b

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-75fgg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-75b361-5865586895-n8bqc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-75b361-5865586895-n8bqc

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-9845b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-9845b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-9845b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-9845b

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-75fgg

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-75fgg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-75b361-5d9d794d86

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-75b361-5d9d794d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-75b361: serviceaccount "payload-processing-e2e-shared-b-w0-75b361" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-75b361-5d9d794d86

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-75b361-5d9d794d86-dlpq7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-75b361

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-75b361-5865586895 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-75b361-5865586895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-75b361-5865586895-n8bqc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-75b361-5865586895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-75b361-5865586895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-75b361: serviceaccount "payload-processing-e2e-shared-b-w0-75b361" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-75fgg

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-75b361

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-75b361-5d9d794d86 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-75b361-5d9d794d86-dlpq7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-75b361-5d9d794d86-dlpq7

AddedInterface

Add eth0 [10.132.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-75b361-5865586895-n8bqc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-75b361-5865586895-n8bqc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-75b361-5d9d794d86-dlpq7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-75b361-5d9d794d86-dlpq7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

ProbeError

Readiness probe error: Get "http://10.132.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

Unhealthy

Readiness probe failed: Get "http://10.132.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c9bce8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c9bce8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-75b361-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

ProbeError

Startup probe error: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

Unhealthy

Startup probe failed: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-75b361-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4d2317-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4d2317-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf

SuccessfulCreate

Created pod: e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-8c8241

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-8c8241

openshift-ingress

deployment-controller

e2e-extmod-a-8c8241-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-8c8241-openshift-default-5c9478b8bf from 0 to 1

openshift-ingress

multus

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

AddedInterface

Add eth0 [10.132.1.4/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8c8241-79657d945b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-8c8241-79657d945b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8c8241: serviceaccount "payload-processing-e2e-extmod-a-8c8241" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-8c8241

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-8c8241-79657d945b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-8c8241

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-gjlbp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8c8241: serviceaccount "payload-processing-e2e-extmod-a-8c8241" not found

opendatahub

kubelet

test-curl-7337-fbeb2b

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7337-fbeb2b

AddedInterface

Add eth0 [10.132.1.6/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8c8241-79657d945b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-8c8241-79657d945b-5gwzv

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-gjlbp

Created

Container created

opendatahub

kubelet

test-curl-7337-fbeb2b

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4d2317-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-gjlbp

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-gjlbp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8c8241-79657d945b-5gwzv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-gjlbp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8c8241-79657d945b-5gwzv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8c8241-79657d945b-5gwzv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4d2317-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7337-fbeb2b

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-8c8241-79657d945b-5gwzv

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7337-fbeb2b

Killing

Stopping container test-curl-7337-fbeb2b

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-d97cc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-d97cc8

openshift-ingress

replicaset-controller

e2e-extmod-b-d97cc8-openshift-default-665557959c

SuccessfulCreate

Created pod: e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8

openshift-ingress

deployment-controller

e2e-extmod-b-d97cc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d97cc8-openshift-default-665557959c from 0 to 1

openshift-ingress

multus

e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8

AddedInterface

Add eth0 [10.132.1.8/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d97cc8: serviceaccount "payload-processing-e2e-extmod-b-d97cc8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-d97cc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-d97cc8-758b89656b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d97cc8-758b89656b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-d97cc8-758b89656b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d97cc8: serviceaccount "payload-processing-e2e-extmod-b-d97cc8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-d97cc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d97cc8-758b89656b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-d97cc8-758b89656b-k6rxc

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-6d8p4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-6d8p4

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-6d8p4

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d97cc8-758b89656b-k6rxc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d97cc8-758b89656b-k6rxc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d97cc8-758b89656b-k6rxc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-d97cc8-758b89656b-k6rxc

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-222480

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-222480

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-6d8p4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-6d8p4

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-a-222480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-222480-openshift-default-69cb8bd57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-222480-openshift-default-69cb8bd57

SuccessfulCreate

Created pod: e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8

openshift-ingress

multus

e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-b-w4-7cbcbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9 from 1 to 2
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 10 to 8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

multus

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9

SuccessfulCreate

Created pod: e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7cbcbb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-t6nl5

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-zz7sj

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-222480-65976658b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-222480-65976658b7-m2tql

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-222480

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-222480-655cd8df6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-222480-655cd8df6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-222480-655cd8df6-rvlwx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-222480-655cd8df6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-222480-655cd8df6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-222480: serviceaccount "payload-processing-e2e-extmod-a-222480" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-222480-65976658b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-222480-65976658b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-222480: serviceaccount "payload-processing-e2e-extmod-a-222480" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-222480

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-222480-65976658b7 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

Unhealthy

Startup probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-extmod-a-222480-655cd8df6-rvlwx

AddedInterface

Add eth0 [10.132.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-222480-65976658b7-m2tql

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-222480-65976658b7-m2tql

AddedInterface

Add eth0 [10.132.1.12/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

ProbeError

Startup probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-222480-65976658b7-m2tql

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-222480-65976658b7-m2tql

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-222480-655cd8df6-rvlwx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-222480-655cd8df6-rvlwx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-222480-655cd8df6-rvlwx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-v2dw2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-8rltz

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-hwvnf

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 10 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-autores-836d67-openshift-default-ff47b8b4c

SuccessfulCreate

Created pod: e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2

openshift-ingress

gateway_labeler_controller

e2e-autores-836d67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-836d67

openshift-ingress

deployment-controller

e2e-autores-836d67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-836d67-openshift-default-ff47b8b4c from 0 to 1

openshift-ingress

multus

e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2

AddedInterface

Add eth0 [10.132.1.14/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w0-75b361-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-75b361-openshift-default-d779c697c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-75b361-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w0-75b361-openshift-default-d779c697c

SuccessfulCreate

Created pod: e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

Started

Container started

openshift-ingress

multus

e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-836d67-665d67575f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-836d67-665d67575f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-836d67: serviceaccount "payload-processing-e2e-autores-836d67" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-836d67-5d8bbbf5b8

FailedCreate

Error creating: pods "payload-processing-e2e-autores-836d67-5d8bbbf5b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-836d67: serviceaccount "payload-processing-e2e-autores-836d67" not found
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 8 to 7

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-836d67-5d8bbbf5b8

SuccessfulCreate

Created pod: payload-processing-e2e-autores-836d67-5d8bbbf5b8-x2dzx

openshift-ingress

deployment-controller

payload-processing-e2e-autores-836d67

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-836d67-5d8bbbf5b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-836d67

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-836d67-665d67575f from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-6wnbg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-836d67-665d67575f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-836d67-665d67575f-2mpk8

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-836d67-665d67575f-2mpk8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-autores-836d67-5d8bbbf5b8-x2dzx

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-836d67-665d67575f-2mpk8

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-836d67-665d67575f-2mpk8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-836d67-665d67575f-2mpk8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-836d67-5d8bbbf5b8-x2dzx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-836d67-5d8bbbf5b8-x2dzx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-836d67-5d8bbbf5b8-x2dzx

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

ProbeError

Startup probe error: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

Unhealthy

Startup probe failed: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

Unhealthy

Startup probe failed: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

ProbeError

Startup probe error: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d97cc8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d97cc8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-75b361-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-f6lcg
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-75b361-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-f6lcg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-969878

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-969878

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-68685b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-68685b

openshift-ingress

deployment-controller

e2e-extmod-b-969878-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-969878-openshift-default-74f689c897 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-7cmsq

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 7 to 6

openshift-ingress

replicaset-controller

e2e-extmod-b-969878-openshift-default-74f689c897

SuccessfulCreate

Created pod: e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

openshift-ingress

replicaset-controller

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f

SuccessfulCreate

Created pod: e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

openshift-ingress

deployment-controller

e2e-extmod-a-68685b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-68685b-openshift-default-dd8c4cb8f from 0 to 1

openshift-ingress

multus

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

AddedInterface

Add eth0 [10.132.1.15/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-969878-5fbf8d98cb

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-969878-5fbf8d98cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-969878: serviceaccount "payload-processing-e2e-extmod-b-969878" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-969878

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-969878-686cb65c47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-969878

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-969878-5fbf8d98cb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-969878-5fbf8d98cb

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-969878-5fbf8d98cb-l6tkb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-969878-686cb65c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-969878-686cb65c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-969878: serviceaccount "payload-processing-e2e-extmod-b-969878" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-969878-686cb65c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-969878-686cb65c47-6gjpm

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-969878-5fbf8d98cb-l6tkb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-4npjj

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-969878-686cb65c47-6gjpm

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-969878-686cb65c47-6gjpm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-969878-686cb65c47-6gjpm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-969878-686cb65c47-6gjpm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-969878-5fbf8d98cb-l6tkb

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-68685b-95c569d74

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-68685b-95c569d74-vxj27
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-68685b-95c569d74

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-68685b-95c569d74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-68685b: serviceaccount "payload-processing-e2e-extmod-a-68685b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-68685b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-68685b-95c569d74 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-68685b: serviceaccount "payload-processing-e2e-extmod-a-68685b" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-969878-5fbf8d98cb-l6tkb

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-68685b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-969878-5fbf8d98cb-l6tkb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-4npjj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-4npjj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-4npjj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-68685b-95c569d74-vxj27

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-68685b-95c569d74-vxj27

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-68685b-95c569d74-vxj27

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-68685b-95c569d74-vxj27

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-4npjj

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8c8241-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8c8241-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-4pzf9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-klpl5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x5)

openshift-ingress

kubelet

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

Unhealthy

Startup probe failed: Get "http://10.132.1.4:15021/healthz/ready": dial tcp 10.132.1.4:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

ProbeError

Startup probe error: Get "http://10.132.1.4:15021/healthz/ready": dial tcp 10.132.1.4:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulDelete

Deleted pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-7g96l

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 4 to 3
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c9bce8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c9bce8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-4d5758

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-4d5758

openshift-ingress

deployment-controller

e2e-extmod-b-4d5758-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-4d5758-openshift-default-5d4977d97c from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-4d5758-openshift-default-5d4977d97c

SuccessfulCreate

Created pod: e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx

openshift-ingress

multus

e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx

AddedInterface

Add eth0 [10.132.1.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-twp4p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-4d5758: serviceaccount "payload-processing-e2e-extmod-b-4d5758" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-4d5758: serviceaccount "payload-processing-e2e-extmod-b-4d5758" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-4d5758

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-cntb6

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-4d5758

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-twp4p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-twp4p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-cntb6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-twp4p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-cntb6

AddedInterface

Add eth0 [10.132.1.18/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-twp4p

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-cntb6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-cntb6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-836d67-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-836d67-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4d5758-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4d5758-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-222480-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-222480-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8

ProbeError

Startup probe error: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8

Unhealthy

Startup probe failed: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2

ProbeError

Startup probe error: Get "http://10.132.1.14:15021/healthz/ready": dial tcp 10.132.1.14:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2

Unhealthy

Startup probe failed: Get "http://10.132.1.14:15021/healthz/ready": dial tcp 10.132.1.14:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8c8241-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8c8241-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-hc22z

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-2a2286-openshift-default-6d8868d969

SuccessfulCreate

Created pod: e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-2a2286

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-2a2286

openshift-ingress

deployment-controller

e2e-extmod-b-2a2286-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2a2286-openshift-default-6d8868d969 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-222480-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-222480-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

AddedInterface

Add eth0 [10.132.1.21/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-969878-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-969878-openshift-default-74f689c897 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-969878-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-hc22z

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-969878-openshift-default-74f689c897

SuccessfulCreate

Created pod: e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-836d67-5d8bbbf5b8-x2dzx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-836d67-665d67575f-2mpk8

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

ProbeError

Readiness probe error: Get "http://10.132.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

Unhealthy

Readiness probe failed: Get "http://10.132.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2a2286: serviceaccount "payload-processing-e2e-extmod-b-2a2286" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c-cbhc7

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-2a2286

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-2a2286-866c7dfb84 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2a2286-866c7dfb84

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-2a2286-866c7dfb84-ktc6t

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-2a2286

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-rszxb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-pl6kz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-fbnrm

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2a2286-866c7dfb84

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-2a2286-866c7dfb84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2a2286: serviceaccount "payload-processing-e2e-extmod-b-2a2286" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-2a2286-866c7dfb84-ktc6t

AddedInterface

Add eth0 [10.132.1.22/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c-cbhc7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2a2286-866c7dfb84-ktc6t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c-cbhc7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c-cbhc7

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c-cbhc7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

ProbeError

Startup probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

Unhealthy

Startup probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2a2286-866c7dfb84-ktc6t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2a2286-866c7dfb84-ktc6t

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-836d67-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-836d67-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

ProbeError

Startup probe error: Get "http://10.132.1.15:15021/healthz/ready": dial tcp 10.132.1.15:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8

ProbeError

Startup probe error: Get "http://10.132.1.8:15021/healthz/ready": dial tcp 10.132.1.8:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

Unhealthy

Startup probe failed: Get "http://10.132.1.15:15021/healthz/ready": dial tcp 10.132.1.15:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8

Unhealthy

Startup probe failed: Get "http://10.132.1.8:15021/healthz/ready": dial tcp 10.132.1.8:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-969878-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-969878-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-68685b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-68685b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-68685b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-969878-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-68685b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-969878-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-autores-836d67-openshift-default-ff47b8b4c-rqvr2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-517027-openshift-default-8456974bb5

SuccessfulCreate

Created pod: e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

openshift-ingress

deployment-controller

e2e-extmod-a-517027-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-517027-openshift-default-8456974bb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-517027

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-517027

openshift-ingress

multus

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

AddedInterface

Add eth0 [10.132.1.24/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-517027-587c5945f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-517027-587c5945f5-qgfvs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-517027-587c5945f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-517027-587c5945f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-517027: serviceaccount "payload-processing-e2e-extmod-a-517027" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-517027

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-517027-587c5945f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-517027-869b54f744

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-517027-869b54f744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-517027: serviceaccount "payload-processing-e2e-extmod-a-517027" not found
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-517027-869b54f744

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-517027-869b54f744-6sn2p

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-517027

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-517027-869b54f744 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-517027-587c5945f5-qgfvs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-517027-869b54f744-6sn2p

AddedInterface

Add eth0 [10.132.1.26/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-517027-587c5945f5-qgfvs

AddedInterface

Add eth0 [10.132.1.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-517027-587c5945f5-qgfvs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-517027-869b54f744-6sn2p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-517027-869b54f744-6sn2p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-517027-587c5945f5-qgfvs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-517027-869b54f744-6sn2p

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx

Unhealthy

Startup probe failed: Get "http://10.132.1.17:15021/healthz/ready": dial tcp 10.132.1.17:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx

ProbeError

Startup probe error: Get "http://10.132.1.17:15021/healthz/ready": dial tcp 10.132.1.17:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d97cc8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d97cc8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

ProbeError

Readiness probe error: Get "http://10.132.1.21:15021/healthz/ready": read tcp 10.132.0.2:52824->10.132.1.21:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

Unhealthy

Readiness probe failed: Get "http://10.132.1.21:15021/healthz/ready": read tcp 10.132.0.2:52824->10.132.1.21:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-517027-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-517027-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

ProbeError

Startup probe error: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

Unhealthy

Startup probe failed: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4d5758-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4d5758-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-5f9b3c-openshift-default-779985d877

SuccessfulCreate

Created pod: e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

openshift-ingress

deployment-controller

e2e-extmod-b-5f9b3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-5f9b3c-openshift-default-779985d877 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-5f9b3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-5f9b3c

openshift-ingress

multus

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

AddedInterface

Add eth0 [10.132.1.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-5f9b3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-5f9b3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-5f9b3c-668c96494b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-5f9b3c-668c96494b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-5f9b3c-668c96494b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-5f9b3c: serviceaccount "payload-processing-e2e-extmod-b-5f9b3c" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-5f9b3c-668c96494b-cg7kb

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff-swzth

AddedInterface

Add eth0 [10.132.1.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5f9b3c-668c96494b-cg7kb

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff-swzth

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5f9b3c-668c96494b-cg7kb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-5f9b3c-668c96494b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-5f9b3c-668c96494b-cg7kb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-5f9b3c: serviceaccount "payload-processing-e2e-extmod-b-5f9b3c" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5f9b3c-668c96494b-cg7kb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff-swzth

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff-swzth

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff-swzth

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

Unhealthy

Readiness probe failed: Get "http://10.132.1.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

ProbeError

Readiness probe error: Get "http://10.132.1.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2a2286-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2a2286-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

Unhealthy

Startup probe failed: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

ProbeError

Startup probe error: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-517027-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-517027-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

ProbeError

Readiness probe error: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

Unhealthy

Readiness probe failed: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

Unhealthy

Startup probe failed: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

ProbeError

Startup probe error: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk

Started

Container started

openshift-ingress

multus

e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-2a2286-openshift-default-6d8868d969

SuccessfulCreate

Created pod: e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2a2286-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-2a2286-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2a2286-openshift-default-6d8868d969 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5f9b3c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5f9b3c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk

Unhealthy

Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk

ProbeError

Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-d97cc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d97cc8-openshift-default-665557959c from 1 to 2

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md

Started

Container started

openshift-ingress

multus

e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d97cc8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-d97cc8-openshift-default-665557959c

SuccessfulCreate

Created pod: e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md

Unhealthy

Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md

ProbeError

Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5f9b3c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5f9b3c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

ProbeError

Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-qtslw

Unhealthy

Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hm4v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-89qq9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 4 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-5jtlw

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-sfv6l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-9jqb9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-c2lhh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

AddedInterface

Add eth0 [10.132.1.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 3 to 5

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-c2lhh

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-c2lhh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-c2lhh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-c2lhh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

Unhealthy

Startup probe failed: Get "http://10.132.1.64:15021/healthz/ready": dial tcp 10.132.1.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

ProbeError

Startup probe error: Get "http://10.132.1.64:15021/healthz/ready": dial tcp 10.132.1.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-c2lhh

Unhealthy

Startup probe failed: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-c2lhh

ProbeError

Startup probe error: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-d5bck

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-d5bck

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-d5bck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-d5bck

AddedInterface

Add eth0 [10.132.1.65/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 5 to 9

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-d5bck

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

Unhealthy

Startup probe failed: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

Unhealthy

Startup probe failed: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

Unhealthy

Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

ProbeError

Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-d5bck

Unhealthy

Startup probe failed: Get "http://10.132.1.65:15021/healthz/ready": dial tcp 10.132.1.65:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

ProbeError

Startup probe error: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-d5bck

ProbeError

Startup probe error: Get "http://10.132.1.65:15021/healthz/ready": dial tcp 10.132.1.65:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

ProbeError

Startup probe error: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 9 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-5db77fbd9f-84zhb

AddedInterface

Add eth0 [10.132.1.69/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-84zhb

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5db77fbd9f-84zhb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-84zhb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-84zhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-84zhb

ProbeError

Startup probe error: Get "http://10.132.1.69:15021/healthz/ready": dial tcp 10.132.1.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-84zhb

Unhealthy

Startup probe failed: Get "http://10.132.1.69:15021/healthz/ready": dial tcp 10.132.1.69:15021: connect: connection refused
(x3)

openshift-ingress

deployment-controller

e2e-worker-w3-c1fdd6-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf from 4 to 3

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-r7dlk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c1fdd6-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-d7rkr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-znfv5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-p8jcd

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-p8jcd

openshift-ingress

deployment-controller

e2e-extmod-b-2a2286-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-2a2286-openshift-default-6d8868d969 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-2a2286-openshift-default-6d8868d969

SuccessfulDelete

Deleted pod: e2e-extmod-b-2a2286-openshift-default-6d8868d969-h27mn

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2a2286-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-7a745c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-7a745c-openshift-default-57b8b749 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-7a745c-openshift-default-57b8b749

SuccessfulDelete

Deleted pod: e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a745c-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-779fa3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-779fa3-openshift-default-b556b9b45 from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-779fa3-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

ProbeError

Readiness probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-nlfbc

Unhealthy

Readiness probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-969878-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-969878-openshift-default-74f689c897

SuccessfulDelete

Deleted pod: e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

openshift-ingress

deployment-controller

e2e-extmod-b-969878-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-969878-openshift-default-74f689c897 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-fjpbr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

ProbeError

Readiness probe error: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-swqgs

Unhealthy

Readiness probe failed: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9

SuccessfulDelete

Deleted pod: e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-b24a1a-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-k4mhw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-7wvdl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-b24a1a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7eaeed-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-jp46g

openshift-ingress

deployment-controller

e2e-shared-a-w1-7eaeed-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79 from 2 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w4-7cbcbb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7cbcbb-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-65j9j

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

deployment-controller

e2e-worker-w2-f06af6-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-f06af6-openshift-default-f48f877dc from 3 to 2
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w2-f06af6-openshift-default-f48f877dc

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f06af6-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-8bmgl

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-0eeba5-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w3-0eeba5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-0eeba5-openshift-default-7f66686885 from 2 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-g8rtn

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f63d20

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f63d20

openshift-ingress

deployment-controller

e2e-inf-a-f63d20-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f63d20-openshift-default-6c69599f5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-f63d20-openshift-default-6c69599f5c

SuccessfulCreate

Created pod: e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

openshift-ingress

multus

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f63d20

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f63d20-79ddcbd5c8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f63d20

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f63d20-64dfb99747 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f63d20-79ddcbd5c8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f63d20: serviceaccount "payload-processing-e2e-inf-a-f63d20" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f63d20-79ddcbd5c8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-dsbmn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f63d20-64dfb99747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-wrctx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f63d20-64dfb99747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f63d20: serviceaccount "payload-processing-e2e-inf-a-f63d20" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-wrctx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-dsbmn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-dsbmn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-dsbmn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-wrctx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-dsbmn

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-wrctx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-wrctx

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-zzkkt

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

Unhealthy

Readiness probe failed: Get "http://10.133.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

ProbeError

Readiness probe error: Get "http://10.133.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Unhealthy

Liveness probe failed: Get "https://10.132.0.50:8000/health": context deadline exceeded
(x4)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x12)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": context deadline exceeded

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kkzgw

Unhealthy

Readiness probe failed: Get "https://10.132.0.47:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-msxt7

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

replicaset-controller

e2e-shared-b-w0-75b361-openshift-default-d779c697c

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

openshift-ingress

deployment-controller

e2e-shared-b-w0-75b361-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w0-75b361-openshift-default-d779c697c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-75b361-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-c2k7r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-68685b-95c569d74-vxj27

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-4npjj

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-inf-b-c257e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c257e7-openshift-default-f68cbf4f5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-c257e7-openshift-default-f68cbf4f5

SuccessfulCreate

Created pod: e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2

openshift-ingress

multus

e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c257e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c257e7

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8c8241-79657d945b-5gwzv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-gjlbp

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-tflt6

AddedInterface

Add eth0 [10.132.1.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c257e7-d4df69d7b-5s4bt

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c257e7-d4df69d7b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c257e7-d4df69d7b-5s4bt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c257e7-d4df69d7b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c257e7-d4df69d7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c257e7: serviceaccount "payload-processing-e2e-inf-b-c257e7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c257e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c257e7-d4df69d7b-5s4bt

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c257e7: serviceaccount "payload-processing-e2e-inf-b-c257e7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-tflt6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c257e7-d4df69d7b-5s4bt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-tflt6

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c257e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c257e7-d4df69d7b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-c257e7-d4df69d7b-5s4bt

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-tflt6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-tflt6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-75fgg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-9845b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-68685b-openshift-default-dd8c4cb8f-z5sgq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-68685b-7dcc9c598c-4npjj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-68685b-95c569d74-vxj27

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-shared-a-w0-4d2317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f from 1 to 2

openshift-ingress

multus

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f

SuccessfulCreate

Created pod: e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4d2317-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2a2286-866c7dfb84-ktc6t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2a2286-68b98fcc4c-cbhc7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8c8241-79657d945b-5gwzv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8c8241-c59d94c7f-gjlbp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-9msfb
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m

Unhealthy

Startup probe failed: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m

ProbeError

Startup probe error: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-9msfb

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9msfb

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9msfb

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9msfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9msfb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9msfb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-8c8241-openshift-default-5c9478b8bf-jnmkp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c9bce8-6c76d4788c-9845b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c9bce8-6b8df985dd-75fgg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-c9bce8-openshift-default-5c5b54bfd5-9s2qz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-969878-686cb65c47-6gjpm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-969878-5fbf8d98cb-l6tkb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-2a2286-openshift-default-6d8868d969-pcdqk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-6d8p4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d97cc8-758b89656b-k6rxc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-qnsqx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-t5hh5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-969878-686cb65c47-6gjpm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-969878-5fbf8d98cb-l6tkb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-969878-openshift-default-74f689c897-bzsph

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d97cc8-758b89656b-k6rxc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-vf4md

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2

Unhealthy

Startup probe failed: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-d97cc8-openshift-default-665557959c-796d8

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2

ProbeError

Startup probe error: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d97cc8-7dbb5df47-6d8p4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-s84hv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-ggxvs

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-b7431c-78d6f57bcb-qnsqx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-b7431c-67ff4df979-t5hh5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0eeba5-f7fdd5595-9xplz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0eeba5-75c6455594-8kbxt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w4-b7431c-openshift-default-5cccbf5b4c-qrd5b

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b24a1a-7d8b65f6ff-ggxvs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b24a1a-5bc559f94b-s84hv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-b24a1a-openshift-default-7cbd596bb9-jch5h

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c257e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c257e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-0eeba5-openshift-default-7f66686885-c2kzm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-hwx2w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-q8vd4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-59tph

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-z8lw8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-54d4c4-79d84c6674-jvq68

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-54d4c4-5bc9c76fff-hzg9q

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-89c124-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-89c124-openshift-default-dfcf98449 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-89c124-openshift-default-dfcf98449

SuccessfulCreate

Created pod: e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v

openshift-ingress

gateway_labeler_controller

e2e-inf-a-89c124

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-89c124

openshift-ingress

multus

e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v

AddedInterface

Add eth0 [10.132.1.126/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-7cbcbb-openshift-default-666c99dff9-k84lv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7cbcbb-678bf465f-hwx2w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-89c124

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-89c124-5694d4b8c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-89c124-5694d4b8c4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-89c124-5694d4b8c4-dlbnw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-89c124-5694d4b8c4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-89c124-5694d4b8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-89c124: serviceaccount "payload-processing-e2e-inf-a-89c124" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-89c124

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-89c124-b8cccb68c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-89c124-b8cccb68c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-8rlnl
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7cbcbb-69f8f4d74d-q8vd4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-89c124-b8cccb68c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-89c124: serviceaccount "payload-processing-e2e-inf-a-89c124" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-8rlnl

AddedInterface

Add eth0 [10.132.1.128/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-89c124-5694d4b8c4-dlbnw

AddedInterface

Add eth0 [10.132.1.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-89c124-5694d4b8c4-dlbnw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-89c124-5694d4b8c4-dlbnw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-89c124-5694d4b8c4-dlbnw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-8rlnl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-8rlnl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-8rlnl

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-gjmfm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-sdp74

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-54d4c4-openshift-default-78b74cbf7-dxq2m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-779fa3-openshift-default-b556b9b45-mnmwq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-779fa3-848d5f4b47-z8lw8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-779fa3-7bcf9b566-59tph

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f06af6-77784df88-qg6p6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-ccgjb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-w9t9z

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2a3e1b-7dd684b74c-gjmfm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2a3e1b-5bff84b45d-sdp74

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-inf-b-bdf9e6-openshift-default-5bd8499f7

SuccessfulCreate

Created pod: e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww

openshift-ingress

deployment-controller

e2e-inf-b-bdf9e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-bdf9e6-openshift-default-5bd8499f7 from 0 to 1

openshift-ingress

multus

e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww

AddedInterface

Add eth0 [10.132.1.138/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-bdf9e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-bdf9e6
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c1fdd6-76556ddfb-w9t9z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c1fdd6-5d68c879bc-ccgjb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-7966j

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-7966j

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-bdf9e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-bdf9e6-7544c775f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-7966j

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bdf9e6-7544c775f8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-bdf9e6-7544c775f8-dcjpn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bdf9e6-c87885855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bdf9e6: serviceaccount "payload-processing-e2e-inf-b-bdf9e6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bdf9e6-c87885855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-7966j

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-7966j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bdf9e6-7544c775f8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-bdf9e6-7544c775f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bdf9e6: serviceaccount "payload-processing-e2e-inf-b-bdf9e6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-bdf9e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-bdf9e6-c87885855 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdf9e6-7544c775f8-dcjpn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdf9e6-7544c775f8-dcjpn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdf9e6-7544c775f8-dcjpn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-bdf9e6-7544c775f8-dcjpn

AddedInterface

Add eth0 [10.132.1.139/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f06af6-77784df88-qg6p6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f06af6-7fcf74dbd7-s9jrs

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.69:50052" within 1s: context deadline exceeded
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-f63d20-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-f63d20-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-97tr2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-f06af6-openshift-default-f48f877dc-8c68q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-t5cl2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-5hvzw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-c1fdd6-openshift-default-5845b6b8cf-tp4x5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-89c124-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-89c124-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-hxf6t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-2a3e1b-openshift-default-679cc6f7f7-kpkwc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v

Unhealthy

Startup probe failed: Get "http://10.132.1.126:15021/healthz/ready": dial tcp 10.132.1.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v

ProbeError

Startup probe error: Get "http://10.132.1.126:15021/healthz/ready": dial tcp 10.132.1.126:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-bdf9e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-bdf9e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-89c124-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-89c124-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww

ProbeError

Startup probe error: Get "http://10.132.1.138:15021/healthz/ready": dial tcp 10.132.1.138:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww

Unhealthy

Startup probe failed: Get "http://10.132.1.138:15021/healthz/ready": dial tcp 10.132.1.138:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-bdf9e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-bdf9e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-wrctx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-dsbmn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f63d20-64dfb99747-wrctx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f63d20-79ddcbd5c8-dsbmn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-f63d20-openshift-default-6c69599f5c-dccsp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-tflt6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c257e7-d4df69d7b-5s4bt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-8rlnl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-89c124-5694d4b8c4-dlbnw

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c257e7-5c54cb9c47-tflt6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-c257e7-openshift-default-f68cbf4f5-4vvk2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-9msfb

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9msfb

Killing

Stopping container discovery
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

kubelet

e2e-inf-a-89c124-openshift-default-dfcf98449-kv85v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-517027-587c5945f5-qgfvs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-517027-869b54f744-6sn2p

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rgs5c

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 10 to 9
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-89c124-b8cccb68c-8rlnl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-7966j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdf9e6-7544c775f8-dcjpn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-517027-openshift-default-8456974bb5-6p6rq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-517027-869b54f744-6sn2p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-517027-587c5945f5-qgfvs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-bdf9e6-openshift-default-5bd8499f7-j6pww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5f9b3c-668c96494b-cg7kb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5f9b3c-5f484d6cff-swzth

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdf9e6-c87885855-7966j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 9 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-rbwvb

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-222480-655cd8df6-rvlwx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-222480-65976658b7-m2tql

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-5f9b3c-openshift-default-779985d877-ngv72

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-rs668

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-8q54p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-222480-openshift-default-69cb8bd57-z26b8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-222480-65976658b7-m2tql

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-222480-655cd8df6-rvlwx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-cntb6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-7eaeed-openshift-default-694c55cd79-b4r88

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-twp4p

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7eaeed-787bbc65ff-rs668

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7eaeed-55b5cfcb9b-8q54p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-bxr9v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-vpm56

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-4d5758-openshift-default-5d4977d97c-wrjdx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4d5758-6985bf95bc-twp4p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4d5758-66cf9d6b6d-cntb6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-981ee5-openshift-default-cb9d68d7c-ljs5f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4d2317-7c657ff4f5-mzsbd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4d2317-75c7f66df4-4784l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-bf7sk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-981ee5-d656456c-vpm56

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-981ee5-684c7cfc78-bxr9v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-vz68m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-4d2317-openshift-default-7ccd49676f-phrkm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-75b361-5d9d794d86-dlpq7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-75b361-5865586895-n8bqc

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-plugins-e2e-worker-w1-7a745c" not found
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a745c-69b56f599-z6ztc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a745c-c7bc6d4fd-bf7sk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-885fr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a745c-openshift-default-57b8b749-6c4cv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-75b361-openshift-default-d779c697c-5s7j8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8836a8-7f7565d946-zl9c7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-vc4fk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-d5bck

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 8 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-d5bck

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-mhqnr

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w0-8836a8-openshift-default-84f65665d5

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh
(x6)

openshift-ingress

deployment-controller

e2e-worker-w0-8836a8-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-8836a8-openshift-default-84f65665d5 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-8836a8-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8836a8-5847dc85d7-vc4fk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-4xjgh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8836a8-7f7565d946-zl9c7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-mpltp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-8836a8-openshift-default-84f65665d5-p7hsc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lhxgc

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-lhxgc

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-c2lhh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 6 to 5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-c2lhh
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 5 to 4
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-84zhb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-84zhb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 4 to 2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-clbw6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-x6hbg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-clbw6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5db77fbd9f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 2 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5db77fbd9f-sjbzh

Killing

Stopping container istio-proxy