Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c4be41-openshift-default-686574f97c-phvtc to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-d8d99

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-d8d99 to ip-10-0-140-164.us-west-1.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-4mfd5

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-4mfd5 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929 to ip-10-0-140-164.us-west-1.compute.internal

opendatahub

ai-gateway-controller-58f5dc44b9-c98xl

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-58f5dc44b9-c98xl to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg to ip-10-0-141-86.us-west-1.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-qb6hx

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-qb6hx to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp to ip-10-0-140-164.us-west-1.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-xl296

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-xl296 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn to ip-10-0-133-197.us-west-1.compute.internal

kuadrant-system

authorino-56c6c9ddd5-m94b9

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-m94b9 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-42c96d-5696f4c5ff-bd6kc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-42c96d-5696f4c5ff-bd6kc to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-2c70e7-5cf6795dc5-4jsj9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2c70e7-5cf6795dc5-4jsj9 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-01cbd8-75c567cb95-tpmh5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-01cbd8-75c567cb95-tpmh5 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-7cec02-6d95f44b95-wgspn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-7cec02-6d95f44b95-wgspn to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-f94871a1-59f8f6cd77-c5g2q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f94871a1-59f8f6cd77-c5g2q to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx to ip-10-0-141-86.us-west-1.compute.internal

kuadrant-system

authorino-57c84b77c7-h6nf2

Scheduled

Successfully assigned kuadrant-system/authorino-57c84b77c7-h6nf2 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-870eefeb-6f5465c587-ppmxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-870eefeb-6f5465c587-ppmxf to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-7164dd00-6c7b4c868c-6h8bv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-7164dd00-6c7b4c868c-6h8bv to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-14ca09-59f575c7d9-ttflk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-14ca09-59f575c7d9-ttflk to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-57ea84-6898c65697-gwhtj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-57ea84-6898c65697-gwhtj to ip-10-0-140-164.us-west-1.compute.internal

kuadrant-system

authorino-57f7f8659f-lf4j2

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-lf4j2 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-tlb5m

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-tlb5m to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-fc5pl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-fc5pl to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-gvgv8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-gvgv8 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-6m8q6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-6m8q6 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-bc2046-579d7d879-mkdpx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-bc2046-579d7d879-mkdpx to ip-10-0-133-197.us-west-1.compute.internal

kuadrant-system

authorino-65fdc4ffcd-ncpr6

Scheduled

Successfully assigned kuadrant-system/authorino-65fdc4ffcd-ncpr6 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-j2fpn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-j2fpn to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-9jjs4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-9jjs4 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc-r588c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc-r588c to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999-rv754

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999-rv754 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95-tgzcf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95-tgzcf to ip-10-0-140-164.us-west-1.compute.internal

opendatahub

odh-model-controller-769875db56-z94np

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-z94np to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899-7hrbw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899-7hrbw to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-e7eea9-7699bc58bf-b8snr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-e7eea9-7699bc58bf-b8snr to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7-pkp25

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7-pkp25 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff-j4zz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff-j4zz4 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f-92nmw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f-92nmw to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc-vx5pq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc-vx5pq to ip-10-0-140-164.us-west-1.compute.internal

kuadrant-system

authorino-6f6944bcdd-4pj7h

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-4pj7h to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775-kdcph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775-kdcph to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc-xf68k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc-xf68k to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-99145d-7d5667799-hfvwn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-99145d-7d5667799-hfvwn to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-autores-183266-79fdd5fc69-b7g4q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-183266-79fdd5fc69-b7g4q to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-derive-b9656f65-79bd98bcf7-fwcj9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b9656f65-79bd98bcf7-fwcj9 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-476ce2-869447977f-cvzpf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-476ce2-869447977f-cvzpf to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9-wrm5h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9-wrm5h to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf-rhnk6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf-rhnk6 to ip-10-0-140-164.us-west-1.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-v8knf

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-v8knf to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-k4ggk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-k4ggk to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c-7m86r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c-7m86r to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72

Scheduled

Successfully assigned openshift-ingress/e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7-bjwb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7-bjwb5 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc-fhmqm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc-fhmqm to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-18bf762c-c84588867-fcv87

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-18bf762c-c84588867-fcv87 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-8774l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-8774l to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-df5d0b-888475979-kzbmv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-df5d0b-888475979-kzbmv to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-7ff59956fc-sgs8x

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ff59956fc-sgs8x to ip-10-0-140-164.us-west-1.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-2nnh7

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-2nnh7 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

Scheduled

Successfully assigned openshift-ingress/e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-f4lr4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-f4lr4 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff-kfxnh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff-kfxnh to ip-10-0-141-86.us-west-1.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-m5wd8

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-m5wd8 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-l6v7x

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l6v7x to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6b748b6585wg7kb

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6b748b6585wg7kb to ip-10-0-133-197.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-559fd7ff56-m5c2x to ip-10-0-133-197.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-9mrpk

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-9mrpk to ip-10-0-133-197.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-559fd7ff56-hbjp8 to ip-10-0-140-164.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-559fd7ff56-2hltz

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-559fd7ff56-2hltz to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lbd4m to ip-10-0-141-86.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-cz9bm

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-cz9bm to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66 to ip-10-0-140-164.us-west-1.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-sg6nz

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-sg6nz to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm to ip-10-0-133-197.us-west-1.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-lzwxw

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lzwxw to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-7ff59956fc-j96vj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ff59956fc-j96vj to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2 to ip-10-0-140-164.us-west-1.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-wjnkz

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-wjnkz to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f-c2lr8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f-c2lr8 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc-698bw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc-698bw to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8af859-794678d7b7-npqqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8af859-794678d7b7-npqqw to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-hh6x7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-hh6x7 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-447154-56895c4795-7g5ff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-447154-56895c4795-7g5ff to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-447154-54c6dc-bbxpl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-447154-54c6dc-bbxpl to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-dffft

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-dffft to ip-10-0-140-164.us-west-1.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-vlvpt

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-vlvpt to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8 to ip-10-0-133-197.us-west-1.compute.internal

cert-manager

cert-manager-597b95cb84-k64tr

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-k64tr to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5-g7mgs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5-g7mgs to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9-87s2t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9-87s2t to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

Scheduled

Successfully assigned openshift-ingress/e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc-tqmfm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc-tqmfm to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-53af08-5f4977594c-xwmrt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-53af08-5f4977594c-xwmrt to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9-6bbsz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9-6bbsz to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3d3023-865744f895-8x2qn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3d3023-865744f895-8x2qn to ip-10-0-140-164.us-west-1.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-svrmp

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-svrmp to ip-10-0-133-197.us-west-1.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-cn7gj

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-cn7gj to ip-10-0-133-197.us-west-1.compute.internal

kuadrant-system

authorino-6d5979fb47-wtnx9

Scheduled

Successfully assigned kuadrant-system/authorino-6d5979fb47-wtnx9 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-autores-183266-openshift-default-74c6876c79-qqthj

Scheduled

Successfully assigned openshift-ingress/e2e-autores-183266-openshift-default-74c6876c79-qqthj to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw to ip-10-0-133-197.us-west-1.compute.internal

opendatahub

model-serving-api-75bd89fdfc-vsw6f

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-vsw6f to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-44qpc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-44qpc to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-5ks26 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-5tdsb to ip-10-0-140-164.us-west-1.compute.internal

opendatahub

maas-controller-c8c48b985-tz8ck

Scheduled

Successfully assigned opendatahub/maas-controller-c8c48b985-tz8ck to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-7f274

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-7f274 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6 to ip-10-0-140-164.us-west-1.compute.internal

opendatahub

maas-controller-67964d995-7k9zg

Scheduled

Successfully assigned opendatahub/maas-controller-67964d995-7k9zg to ip-10-0-141-86.us-west-1.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-wl4pk

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wl4pk to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3d3023-699676b967-fldkz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3d3023-699676b967-fldkz to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c4be41-ccb87495-zm97g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c4be41-ccb87495-zm97g to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-b9656f65-755b48cd75-lpd6d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b9656f65-755b48cd75-lpd6d to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-183266-6b84795bc-lpxpk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-183266-6b84795bc-lpxpk to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7-wdd67

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7-wdd67 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-explicit-c4be41-5bd8d689f9-4275p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c4be41-5bd8d689f9-4275p to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-3d3023-78f9898c59-h98z2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3d3023-78f9898c59-h98z2 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-3d3023-f7875fb5b-hck6m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3d3023-f7875fb5b-hck6m to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-53af08-65d5bc6896-8bjdx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-53af08-65d5bc6896-8bjdx to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-53af08-6f5cbc65ff-k2nmk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-53af08-6f5cbc65ff-k2nmk to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-99c8bd-54b85b659f-9kck6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-99c8bd-54b85b659f-9kck6 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-99c8bd-8c75c7944-76r8f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-99c8bd-8c75c7944-76r8f to ip-10-0-140-164.us-west-1.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-dls47

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-dls47 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-9e5368-7b876c5d49-4zpqb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9e5368-7b876c5d49-4zpqb to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-bc2046-686fddbb8c-mrwqg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-bc2046-686fddbb8c-mrwqg to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-9e5368-9b9c69d6-t2ksv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9e5368-9b9c69d6-t2ksv to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-57ea84-85d5768fdc-p58qg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-57ea84-85d5768fdc-p58qg to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-447154-78d7bc47bf-gfzrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-447154-78d7bc47bf-gfzrx to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-447154-86f756f86b-vqtbx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-447154-86f756f86b-vqtbx to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8af859-6d6894c5d-wfdlq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8af859-6d6894c5d-wfdlq to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8af859-96d6c7797-tkjx8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8af859-96d6c7797-tkjx8 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-b2d49b-7d964db466-npfgm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b2d49b-7d964db466-npfgm to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-b2d49b-b7b76c997-5vm2r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b2d49b-b7b76c997-5vm2r to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-df5d0b-5795dbdff7-4x82m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-df5d0b-5795dbdff7-4x82m to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-df5d0b-f4fc9b794-c65p5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-df5d0b-f4fc9b794-c65p5 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-migrate-a0c7a371-7d55468d95-tjb8l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a0c7a371-7d55468d95-tjb8l to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-14ca09-589f7f47b7-c9tf5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-14ca09-589f7f47b7-c9tf5 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-mt-18bf762c-6cc59897d9-w4n2s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-18bf762c-6cc59897d9-w4n2s to ip-10-0-133-197.us-west-1.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-7rlk4

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-7rlk4 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-7cec02-64cb84f795-865w7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-7cec02-64cb84f795-865w7 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-42c96d-65764fbd8c-84plq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-42c96d-65764fbd8c-84plq to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7-l82mc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7-l82mc to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-01cbd8-f74599447-dqk2f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-01cbd8-f74599447-dqk2f to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-3b7279-667b9df887-n49j9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-3b7279-667b9df887-n49j9 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-8a3796-5954d5d847-c4bm9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-8a3796-5954d5d847-c4bm9 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9-djhv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9-djhv5 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-c0daf4-77876767f-gc2dx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-c0daf4-77876767f-gc2dx to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-c116f3-78c68787f-dvczw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-c116f3-78c68787f-dvczw to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-2c0de9-f5cc7596c-j6k5n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-2c0de9-f5cc7596c-j6k5n to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f-qgwxl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f-qgwxl to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-99145d-fc449dc4f-zmf85

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-99145d-fc449dc4f-zmf85 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc-skdst

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc-skdst to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-e59f12-7dc7465c5c-25kvh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-e59f12-7dc7465c5c-25kvh to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv to ip-10-0-141-86.us-west-1.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-x8krt

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-x8krt to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f-6lb9k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f-6lb9k to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f-hcptx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f-hcptx to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9-8svzg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9-8svzg to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5-llpqq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5-llpqq to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-051514-546778dd4c-vbm49

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-051514-546778dd4c-vbm49 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-k4vmp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-k4vmp to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7-fb4jh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7-fb4jh to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-5632ea-8694dd957f-hrfm2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-5632ea-8694dd957f-hrfm2 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-c4d438-54dd98698f-vtppv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-c4d438-54dd98698f-vtppv to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-d4fmr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-d4fmr to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-870eefeb-565c4c4655-tx5wj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-870eefeb-565c4c4655-tx5wj to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9-24xtq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9-24xtq to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-baacee-7c84b68df5-hp4s4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-baacee-7c84b68df5-hp4s4 to ip-10-0-140-164.us-west-1.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hwv2f

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hwv2f to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-rsgqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-rsgqk to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-9mzcr to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-00e840-5f5d89756f-ngbn2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-00e840-5f5d89756f-ngbn2 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7 to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-trv8z to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-klw8t to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc to ip-10-0-140-164.us-west-1.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-ht5d9

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-ht5d9 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-a8e157-69ffccd74c-z9zls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-a8e157-69ffccd74c-z9zls to ip-10-0-133-197.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-dcfg5

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-dcfg5 to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp to ip-10-0-133-197.us-west-1.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-2p64m

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-2p64m to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-6b78c66f8c-wxwks

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6b78c66f8c-wxwks to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-tchdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-tchdk to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx to ip-10-0-141-86.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

router-default-5964fff8f9-8k6pp

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-5964fff8f9-8k6pp

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

router-default-5964fff8f9-8k6pp

Scheduled

Successfully assigned openshift-ingress/router-default-5964fff8f9-8k6pp to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-jn9hq to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-jg8xt to ip-10-0-140-164.us-west-1.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-76tzr

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-76tzr to ip-10-0-133-197.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-d4qqv

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-d4qqv to ip-10-0-141-86.us-west-1.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7 to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-jd7bn to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-75fd9f5d47-b4hfr to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd to ip-10-0-140-164.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55 to ip-10-0-140-164.us-west-1.compute.internal

openshift-jobset-operator

jobset-controller-manager-66db79789b-2jk8v

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-66db79789b-2jk8v to ip-10-0-133-197.us-west-1.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5964fff8f9 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-5964fff8f9

SuccessfulCreate

Created pod: router-default-5964fff8f9-8k6pp
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-5964fff8f9-8k6pp

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-5964fff8f9-8k6pp

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-5964fff8f9-8k6pp

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-5964fff8f9-8k6pp

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-5964fff8f9-8k6pp

Created

Container created

openshift-ingress

kubelet

router-default-5964fff8f9-8k6pp

Started

Container started

openshift-ingress

multus

router-default-5964fff8f9-8k6pp

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-d8d99

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-d8d99

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-d8d99

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-d8d99

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.429s (4.429s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-d8d99

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-d8d99

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75fd9f5d47 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75fd9f5d47-jn9hq
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-d8d99

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-d8d99

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-6b78c66f8c-wxwks

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-6b78c66f8c from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-6b78c66f8c

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-6b78c66f8c-wxwks

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6b78c66f8c-wxwks

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6b78c66f8c-wxwks

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6b78c66f8c-wxwks

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.206s (4.206s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6b78c66f8c-wxwks

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.638s (6.638s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-ht5d9

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-ht5d9

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-ht5d9

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-ht5d9

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.81s (2.81s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-ht5d9

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-ht5d9

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-ht5d9_10c048c7-df46-412b-b246-f90a01518fa1 became leader
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-559fd7ff56

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-559fd7ff56-m5c2x

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-559fd7ff56 from 0 to 3

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-559fd7ff56

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-559fd7ff56-hbjp8

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-559fd7ff56

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-559fd7ff56-2hltz

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-2hltz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-559fd7ff56-2hltz

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

operator-lifecycle-manager

install-l4zms

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-2hltz

Started

Container started

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-2hltz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.311s (3.311s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.567s (3.567s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-2hltz

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-2hltz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.388s (3.388s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

Started

Container started

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-2hltz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 876ms (876ms including waiting). Image size: 273709574 bytes.

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-qb6hx

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-2hltz

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-2hltz

Started

Container started
(x7)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-m5c2x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 784ms (784ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 813ms (813ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-559fd7ff56-hbjp8

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-qb6hx

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

opendatahub-operator-system

opendatahub-operator-controller-manager-559fd7ff56-hbjp8_055e9677-bdaa-4474-89ab-54615bf8baac

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-559fd7ff56-hbjp8_055e9677-bdaa-4474-89ab-54615bf8baac became leader

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-qb6hx

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-4mfd5

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-4mfd5

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-4mfd5

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-qb6hx

Created

Container created
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-qb6hx

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.465s (4.465s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-qb6hx

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-4mfd5

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.594s (3.594s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-4mfd5

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-4mfd5

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-cz9bm

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-cz9bm

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-k64tr

cert-manager

multus

cert-manager-597b95cb84-k64tr

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-cz9bm

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-k64tr

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-k64tr

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-k64tr

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-2nnh7

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-2nnh7

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-2nnh7

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-cz9bm

Created

Container created

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-svrmp

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-svrmp

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-cz9bm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.899s (5.899s including waiting). Image size: 424244516 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-cz9bm

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-cz9bm_f4b3ba1b-0f9c-4e13-912f-ab7d997d06e1

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-cz9bm_f4b3ba1b-0f9c-4e13-912f-ab7d997d06e1 became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-svrmp

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-2nnh7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 3.863s (3.863s including waiting). Image size: 190804149 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-2nnh7_6b3490d5-1290-4478-8d57-2a31011bb9dc

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-2nnh7_6b3490d5-1290-4478-8d57-2a31011bb9dc became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-2nnh7

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-2nnh7

Started

Container started

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-v8knf

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-svrmp

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-svrmp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.448s (2.448s including waiting). Image size: 177967631 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-svrmp

Created

Container created

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

multus

authorino-operator-7b7bb4bc77-v8knf

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

kuadrant-system

limitador-operator-controller-manager-5778bb4449-svrmp_328baa11-21c6-43fc-81c2-feded819dd8f

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-svrmp_328baa11-21c6-43fc-81c2-feded819dd8f became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-v8knf

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-m5wd8

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-m5wd8

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-m5wd8

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-v8knf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 3.433s (3.433s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-v8knf

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-v8knf

Started

Container started

kuadrant-system

authorino-operator-7b7bb4bc77-v8knf_681e6c93-66cf-46ba-bc79-cbb51057b0a4

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-v8knf_681e6c93-66cf-46ba-bc79-cbb51057b0a4 became leader

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-m5wd8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.063s (6.063s including waiting). Image size: 342538866 bytes.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-m5wd8

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-9mrpk

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-m5wd8

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-9mrpk

Created

Container created

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-9mrpk

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-9mrpk

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-9mrpk

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-cz9bm

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-cz9bm

Killing

Stopping container manager

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-ff8ts"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-6fftc"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7ff59956fc from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7ff59956fc

SuccessfulCreate

Created pod: kube-auth-proxy-7ff59956fc-sgs8x

openshift-ingress

replicaset-controller

kube-auth-proxy-7ff59956fc

SuccessfulCreate

Created pod: kube-auth-proxy-7ff59956fc-j96vj

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-ingress

multus

kube-auth-proxy-7ff59956fc-j96vj

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6b748b6585

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6b748b6585wg7kb

openshift-ingress

multus

kube-auth-proxy-7ff59956fc-sgs8x

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6b748b6585 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-7ff59956fc-sgs8x

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

kube-auth-proxy-7ff59956fc-j96vj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6b748b6585wg7kb

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6b748b6585wg7kb

Started

Container started

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6b748b6585wg7kb

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6b748b6585wg7kb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-66db79789b

SuccessfulCreate

Created pod: jobset-controller-manager-66db79789b-2jk8v

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-66db79789b from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-7ff59956fc-sgs8x

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-66db79789b-2jk8v

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-ingress

kubelet

kube-auth-proxy-7ff59956fc-j96vj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.951s (2.951s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7ff59956fc-j96vj

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7ff59956fc-j96vj

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7ff59956fc-sgs8x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.852s (2.852s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7ff59956fc-sgs8x

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

multus

jobset-controller-manager-66db79789b-2jk8v

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-66db79789b-2jk8v

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-66db79789b-2jk8v

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.89s (3.89s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-66db79789b-2jk8v

Started

Container started

openshift-jobset-operator

jobset-controller-manager-66db79789b-2jk8v_a81618cd-e709-471d-83c6-565f16dff047

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-66db79789b-2jk8v_a81618cd-e709-471d-83c6-565f16dff047 became leader

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-sg6nz

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-sg6nz

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-sg6nz

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-9mrpk_a1138d25-524b-4104-af5a-7b6c7557fc1b

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-9mrpk_a1138d25-524b-4104-af5a-7b6c7557fc1b became leader

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-sg6nz

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-sg6nz

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-sg6nz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.344s (2.344s including waiting). Image size: 195729000 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-wjnkz

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wjnkz

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-wjnkz

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-lf4j2

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

multus

authorino-57f7f8659f-lf4j2

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-lf4j2

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-57f7f8659f-lf4j2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.444s (2.444s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wjnkz

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wjnkz

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wjnkz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.563s (3.563s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-lf4j2

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-lf4j2

Created

Container created

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-vlvpt

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-m94b9

kuadrant-system

kubelet

authorino-56c6c9ddd5-m94b9

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

limitador-limitador-7c9b87d574-vlvpt

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vlvpt

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

authorino-56c6c9ddd5-m94b9

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-m94b9

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-m94b9

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-m94b9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.329s (1.329s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-lf4j2

Killing

Stopping container authorino

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vlvpt

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vlvpt

Started

Container started

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-lf4j2

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vlvpt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.885s (1.885s including waiting). Image size: 133379307 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kserve-module-controller-manager-7566cf5fc8-sg6nz_5e8c2e4c-f4b5-4f7a-83c9-2d621bbbb7ff

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-sg6nz_5e8c2e4c-f4b5-4f7a-83c9-2d621bbbb7ff became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wjnkz

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-wjnkz

opendatahub

replicaset-controller

maas-controller-67964d995

SuccessfulCreate

Created pod: maas-controller-67964d995-7k9zg

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-l6v7x

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-67964d995 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l6v7x

Started

Container started

opendatahub

kubelet

maas-controller-67964d995-7k9zg

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:fe2e13b40999edb4dd54a2bacaa8c6aae627b45eb42b8221f9336f13c080d755"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-l6v7x

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l6v7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

opendatahub

kubelet

maas-controller-c8c48b985-tz8ck

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:fe2e13b40999edb4dd54a2bacaa8c6aae627b45eb42b8221f9336f13c080d755"

opendatahub

multus

maas-controller-c8c48b985-tz8ck

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-c8c48b985

SuccessfulCreate

Created pod: maas-controller-c8c48b985-tz8ck

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l6v7x

Created

Container created

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-c8c48b985 from 0 to 1

opendatahub

multus

maas-controller-67964d995-7k9zg

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l6v7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l6v7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-d8d99

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-d8d99

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-xl296

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xl296

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

odh-model-controller-769875db56-z94np

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

model-serving-api-75bd89fdfc-vsw6f

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-z94np

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-d4qqv

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

model-serving-api-75bd89fdfc-vsw6f

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

kserve-controller-manager-776cc66d47-xl296

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

multus

odh-model-controller-769875db56-z94np

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-d4qqv

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-d4qqv

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-vsw6f

opendatahub

kubelet

maas-controller-67964d995-7k9zg

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:fe2e13b40999edb4dd54a2bacaa8c6aae627b45eb42b8221f9336f13c080d755" in 7.039s (7.039s including waiting). Image size: 200069639 bytes.

opendatahub

kubelet

maas-controller-c8c48b985-tz8ck

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:fe2e13b40999edb4dd54a2bacaa8c6aae627b45eb42b8221f9336f13c080d755" in 6.49s (6.49s including waiting). Image size: 200069639 bytes.

opendatahub

kubelet

maas-controller-67964d995-7k9zg

Created

Container created

opendatahub

kubelet

maas-controller-c8c48b985-tz8ck

Started

Container started

opendatahub

kubelet

maas-controller-c8c48b985-tz8ck

Created

Container created

opendatahub

kubelet

maas-controller-67964d995-7k9zg

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xl296

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-vsw6f

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-vsw6f

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-vsw6f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.646s (2.646s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-z94np

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.984s (2.984s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xl296

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xl296

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.967s (2.967s including waiting). Image size: 247676581 bytes.

opendatahub

maas-controller-c8c48b985-tz8ck_8c9a40ff-3de6-4b36-a983-be0604a136a4

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-c8c48b985-tz8ck_8c9a40ff-3de6-4b36-a983-be0604a136a4 became leader

opendatahub

odh-model-controller-769875db56-z94np_e657075c-8999-4be0-a7cc-77d52b6d2af6

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-z94np_e657075c-8999-4be0-a7cc-77d52b6d2af6 became leader

opendatahub

kubelet

odh-model-controller-769875db56-z94np

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-z94np

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-d4qqv

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-xl296_63e46f1c-d18f-4fb1-ab35-f4be0a45f44a

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-xl296_63e46f1c-d18f-4fb1-ab35-f4be0a45f44a became leader

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-d4qqv

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-d4qqv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.271s (3.271s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lzwxw

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-lzwxw

opendatahub

llmisvc-controller-manager-869d5dcc5d-d4qqv_75f0b69a-cabc-4c87-bbb0-008e04ac105f

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-d4qqv_75f0b69a-cabc-4c87-bbb0-008e04ac105f became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lzwxw

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-lzwxw

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-67964d995 from 1 to 0

opendatahub

replicaset-controller

maas-controller-67964d995

SuccessfulDelete

Deleted pod: maas-controller-67964d995-7k9zg

opendatahub

kubelet

maas-controller-67964d995-7k9zg

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lzwxw

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 13.255s (13.255s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lzwxw

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lzwxw

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

Created

Container created

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-4pj7h

kuadrant-system

replicaset-controller

authorino-6d5979fb47

SuccessfulDelete

Deleted pod: authorino-6d5979fb47-wtnx9

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-4pj7h

kuadrant-system

multus

authorino-6f6944bcdd-4pj7h

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6f6944bcdd-4pj7h

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6d5979fb47-wtnx9

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-6d5979fb47

SuccessfulCreate

Created pod: authorino-6d5979fb47-wtnx9

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6d5979fb47 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6d5979fb47 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57c84b77c7 from 0 to 1

kuadrant-system

replicaset-controller

authorino-57c84b77c7

SuccessfulCreate

Created pod: authorino-57c84b77c7-h6nf2

kuadrant-system

kubelet

authorino-6d5979fb47-wtnx9

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-57c84b77c7-h6nf2

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57c84b77c7-h6nf2

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57c84b77c7-h6nf2

Started

Container started

kuadrant-system

kubelet

authorino-57c84b77c7-h6nf2

Created

Container created

kuadrant-system

kubelet

authorino-57c84b77c7-h6nf2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.28s (1.28s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6d5979fb47-wtnx9

Started

Container started

kuadrant-system

kubelet

authorino-6d5979fb47-wtnx9

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-4pj7h

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6f6944bcdd-4pj7h

Started

Container started

kuadrant-system

kubelet

authorino-6f6944bcdd-4pj7h

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-4pj7h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.78s (1.78s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6d5979fb47-wtnx9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.805s (1.805s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-6d5979fb47-wtnx9

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-m94b9

kuadrant-system

kubelet

authorino-56c6c9ddd5-m94b9

Killing

Stopping container authorino
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-dcfg5

opendatahub

multus

llmisvc-controller-manager-6466c554d8-dcfg5

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-dcfg5

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-dcfg5

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-dcfg5

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-dcfg5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 707ms (707ms including waiting). Image size: 235100981 bytes.
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-d4qqv

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-d4qqv

Killing

Stopping container manager

opendatahub

multus

ai-gateway-controller-7d85675f98-cn7gj

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-cn7gj

opendatahub

kubelet

ai-gateway-controller-7d85675f98-cn7gj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-cn7gj

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-cn7gj

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-cn7gj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.326s (2.326s including waiting). Image size: 183979433 bytes.

opendatahub

ai-gateway-controller-7d85675f98-cn7gj_004057e8-829b-47ef-b842-6ba9b25e4a30

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-cn7gj_004057e8-829b-47ef-b842-6ba9b25e4a30 became leader

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-tlb5m
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-rsgqk
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-rsgqk

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-tlb5m

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-tlb5m

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-rsgqk

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-rsgqk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-rsgqk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.712s (2.712s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-rsgqk

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-tlb5m

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-tlb5m

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-tlb5m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.514s (2.514s including waiting). Image size: 125353965 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-58f5dc44b9 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-58f5dc44b9

SuccessfulCreate

Created pod: ai-gateway-controller-58f5dc44b9-c98xl

opendatahub

kubelet

ai-gateway-controller-58f5dc44b9-c98xl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-58f5dc44b9-c98xl

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

opendatahub

llmisvc-controller-manager-6466c554d8-dcfg5_621babda-3be4-4c4e-8425-762a01c37da9

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-dcfg5_621babda-3be4-4c4e-8425-762a01c37da9 became leader

opendatahub

kubelet

ai-gateway-controller-58f5dc44b9-c98xl

Started

Container started

opendatahub

kubelet

ai-gateway-controller-58f5dc44b9-c98xl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 824ms (824ms including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-58f5dc44b9-c98xl

Created

Container created

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-cn7gj

opendatahub

kubelet

ai-gateway-controller-7d85675f98-cn7gj

Killing

Stopping container manager

opendatahub

ai-gateway-controller-58f5dc44b9-c98xl_8b39ff79-43db-46af-bf56-7e7c9fcd6631

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-58f5dc44b9-c98xl_8b39ff79-43db-46af-bf56-7e7c9fcd6631 became leader

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-wl4pk

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-wl4pk

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-wl4pk

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-wl4pk

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-wl4pk

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.429s (1.429s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-wl4pk

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-dls47

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-dls47

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-dls47

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-dls47

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-dls47

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-dls47

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.466s (1.466s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-7rlk4

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7rlk4

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7rlk4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 572ms (572ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7rlk4

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7rlk4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-7rlk4

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-x8krt

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x8krt

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x8krt

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 575ms (575ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x8krt

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-x8krt

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x8krt

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hwv2f

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hwv2f

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hwv2f

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hwv2f

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 569ms (569ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hwv2f

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hwv2f

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-2p64m

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

multus

echo-simulator-kserve-64b6f8f96c-2p64m

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-2p64m

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-76tzr

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-76tzr

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

echo-simulator-kserve-64b6f8f96c-2p64m

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-2p64m

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-2p64m

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.619s (2.619s including waiting). Image size: 78208878 bytes.

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-76tzr

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-76tzr

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-76tzr

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-76tzr

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 602ms (602ms including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 660ms (660ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75fd9f5d47-trv8z

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75fd9f5d47 from 1 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.155s (4.155s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

replicaset-controller

authorino-65fdc4ffcd

SuccessfulCreate

Created pod: authorino-65fdc4ffcd-ncpr6

kuadrant-system

multus

authorino-65fdc4ffcd-ncpr6

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-65fdc4ffcd-ncpr6

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-65fdc4ffcd-ncpr6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.549s (1.549s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-65fdc4ffcd-ncpr6

Started

Container started

kuadrant-system

kubelet

authorino-65fdc4ffcd-ncpr6

Created

Container created
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-57c84b77c7 from 1 to 0

kuadrant-system

kubelet

authorino-57c84b77c7-h6nf2

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-57c84b77c7

SuccessfulDelete

Deleted pod: authorino-57c84b77c7-h6nf2

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-44qpc

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75fd9f5d47-44qpc

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75fd9f5d47 from 2 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-44qpc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-44qpc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-44qpc

Created

Container created
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-44qpc

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-44qpc

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-f94871a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f94871a1

openshift-ingress

replicaset-controller

e2e-ait-f94871a1-openshift-default-785fbb566c

SuccessfulCreate

Created pod: e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz

openshift-ingress

deployment-controller

e2e-ait-f94871a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f94871a1-openshift-default-785fbb566c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-a0c7a371-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a0c7a371-gw

openshift-ingress

multus

e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585

SuccessfulCreate

Created pod: e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

openshift-ingress

deployment-controller

e2e-migrate-a0c7a371-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-7164dd00

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-7164dd00

openshift-ingress

deployment-controller

e2e-ait-7164dd00-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-7164dd00-openshift-default-75654487cc from 0 to 1

openshift-ingress

multus

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-7164dd00-openshift-default-75654487cc

SuccessfulCreate

Created pod: e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5

openshift-ingress

multus

e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-b9656f65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b9656f65

openshift-ingress

replicaset-controller

e2e-derive-b9656f65-openshift-default-c6f497c7

SuccessfulCreate

Created pod: e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4

openshift-ingress

deployment-controller

e2e-derive-b9656f65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b9656f65-openshift-default-c6f497c7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a0c7a371: serviceaccount "payload-processing-e2e-migrate-a0c7a371" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a0c7a371

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-8774l

openshift-ingress

multus

e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a0c7a371-7d55468d95

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a0c7a371-7d55468d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a0c7a371: serviceaccount "payload-processing-e2e-migrate-a0c7a371" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a0c7a371

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a0c7a371-7d55468d95 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a0c7a371-7d55468d95

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a0c7a371-7d55468d95-tjb8l

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-8774l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0c7a371-7d55468d95-tjb8l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0c7a371-7d55468d95-tjb8l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-8774l

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-a0c7a371-7d55468d95-tjb8l

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0c7a371-7d55468d95-tjb8l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-8774l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-8774l

Started

Container started

openshift-ingress

replicaset-controller

e2e-ait-870eefeb-openshift-default-6b9747f565

SuccessfulCreate

Created pod: e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

openshift-ingress

gateway_labeler_controller

e2e-ait-870eefeb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-870eefeb

openshift-ingress

deployment-controller

e2e-ait-870eefeb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-870eefeb-openshift-default-6b9747f565 from 0 to 1

openshift-ingress

multus

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f94871a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f94871a1-59f8f6cd77 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f94871a1-59f8f6cd77

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f94871a1-59f8f6cd77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f94871a1: serviceaccount "payload-processing-e2e-ait-f94871a1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9-8svzg
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f94871a1: serviceaccount "payload-processing-e2e-ait-f94871a1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f94871a1-59f8f6cd77

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f94871a1-59f8f6cd77-c5g2q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f94871a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-f94871a1-59f8f6cd77-c5g2q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-f94871a1-59f8f6cd77-c5g2q

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f94871a1-59f8f6cd77-c5g2q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-f94871a1-59f8f6cd77-c5g2q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9-8svzg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9-8svzg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9-8svzg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9-8svzg

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7164dd00-6c7b4c868c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-7164dd00-6c7b4c868c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7164dd00: serviceaccount "payload-processing-e2e-ait-7164dd00" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-7164dd00

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-7164dd00-6c7b4c868c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-7164dd00

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7164dd00: serviceaccount "payload-processing-e2e-ait-7164dd00" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9-24xtq

openshift-ingress

kubelet

payload-processing-e2e-ait-7164dd00-6c7b4c868c-6h8bv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-7164dd00-6c7b4c868c-6h8bv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-7164dd00-6c7b4c868c-6h8bv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-7164dd00-6c7b4c868c-6h8bv

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7164dd00-6c7b4c868c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-7164dd00-6c7b4c868c-6h8bv

openshift-ingress

multus

payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9-24xtq

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9-24xtq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9-24xtq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9-24xtq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b9656f65-79bd98bcf7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b9656f65-79bd98bcf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b9656f65: serviceaccount "payload-processing-e2e-derive-b9656f65" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b9656f65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b9656f65-755b48cd75 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-b9656f65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-b9656f65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b9656f65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b9656f65-79bd98bcf7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-b9656f65-79bd98bcf7-fwcj9

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b9656f65-755b48cd75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b9656f65-755b48cd75-lpd6d
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b9656f65-755b48cd75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b9656f65-755b48cd75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b9656f65: serviceaccount "payload-processing-e2e-derive-b9656f65" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b9656f65-79bd98bcf7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b9656f65-79bd98bcf7-fwcj9

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b9656f65-755b48cd75-lpd6d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-b9656f65-79bd98bcf7-fwcj9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-b9656f65-79bd98bcf7-fwcj9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b9656f65-755b48cd75-lpd6d

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-derive-b9656f65-755b48cd75-lpd6d

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b9656f65-755b48cd75-lpd6d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-b9656f65-79bd98bcf7-fwcj9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-870eefeb-565c4c4655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-870eefeb-565c4c4655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-870eefeb: serviceaccount "payload-processing-e2e-ait-870eefeb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-870eefeb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-870eefeb-565c4c4655 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-870eefeb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-870eefeb-6f5465c587 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-870eefeb-6f5465c587

FailedCreate

Error creating: pods "payload-processing-e2e-ait-870eefeb-6f5465c587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-870eefeb: serviceaccount "payload-processing-e2e-ait-870eefeb" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-870eefeb-6f5465c587-ppmxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-870eefeb-565c4c4655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-870eefeb-565c4c4655-tx5wj

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-870eefeb-565c4c4655-tx5wj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-870eefeb-6f5465c587-ppmxf

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-870eefeb-565c4c4655-tx5wj

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-870eefeb-565c4c4655-tx5wj

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-870eefeb-6f5465c587

SuccessfulCreate

Created pod: payload-processing-e2e-ait-870eefeb-6f5465c587-ppmxf

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-870eefeb-565c4c4655-tx5wj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-870eefeb-6f5465c587-ppmxf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-870eefeb-6f5465c587-ppmxf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-870eefeb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-870eefeb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f94871a1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f94871a1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-a0c7a371-7d55468d95-tjb8l

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-8774l

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f94871a1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-a0c7a371-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f94871a1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-a0c7a371-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a0c7a371-7b6d5489b7-8774l

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.37:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-7164dd00-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-7164dd00-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-b9656f65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-b9656f65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-a0c7a371-gw-openshift-default-7857fb8585-vnnng

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-a8e157

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-a8e157

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f94871a1-bf9ddb7c9-8svzg

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

openshift-ingress

kubelet

payload-processing-e2e-ait-f94871a1-59f8f6cd77-c5g2q

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-7164dd00-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-7164dd00-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-a8e157

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-gvgv8
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-a8e157: serviceaccount "payload-processing-e2e-worker-w3-a8e157" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-a8e157-69ffccd74c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-a8e157-69ffccd74c-z9zls

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-a8e157

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-a8e157-69ffccd74c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-a8e157-69ffccd74c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-a8e157-69ffccd74c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-a8e157: serviceaccount "payload-processing-e2e-worker-w3-a8e157" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a8e157-69ffccd74c-z9zls

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-7164dd00-6c7b4c868c-6h8bv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-gvgv8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-gvgv8

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w3-a8e157-69ffccd74c-z9zls

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-gvgv8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-gvgv8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7164dd00-6dcd9d9bc9-24xtq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a8e157-69ffccd74c-z9zls

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a8e157-69ffccd74c-z9zls

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-b9656f65-79bd98bcf7-fwcj9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b9656f65-755b48cd75-lpd6d

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-870eefeb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-870eefeb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-derive-b9656f65-openshift-default-c6f497c7-r4pr4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-870eefeb-6f5465c587-ppmxf

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-baacee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-baacee

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-870eefeb-565c4c4655-tx5wj

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 0 to 1

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

openshift-ingress

kubelet

e2e-ait-f94871a1-openshift-default-785fbb566c-g9qtz

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-baacee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-8f6b5b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-8f6b5b

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-baacee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-baacee-7c84b68df5 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-j2fpn

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-j2fpn
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-baacee: serviceaccount "payload-processing-e2e-worker-w1-baacee" not found

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-baacee-7c84b68df5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-baacee-7c84b68df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-baacee: serviceaccount "payload-processing-e2e-worker-w1-baacee" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-baacee-7c84b68df5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-baacee-7c84b68df5-hp4s4

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-j2fpn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-baacee-7c84b68df5-hp4s4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-baacee-7c84b68df5-hp4s4

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-j2fpn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-baacee-7c84b68df5-hp4s4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-baacee-7c84b68df5-hp4s4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-j2fpn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-00e840

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-00e840

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 0 to 1

openshift-ingress

kubelet

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-870eefeb-openshift-default-6b9747f565-75x6w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-7164dd00-openshift-default-75654487cc-bd9c5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-00e840

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-00e840-5f5d89756f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-6m8q6

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-00e840-5f5d89756f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-00e840-5f5d89756f-ngbn2
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-00e840: serviceaccount "payload-processing-e2e-worker-w2-00e840" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-00e840

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-00e840-5f5d89756f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-00e840-5f5d89756f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-00e840: serviceaccount "payload-processing-e2e-worker-w2-00e840" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-00e840-5f5d89756f-ngbn2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w2-00e840-5f5d89756f-ngbn2

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-6m8q6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-6m8q6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-6m8q6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-6m8q6

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-00e840-5f5d89756f-ngbn2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-00e840-5f5d89756f-ngbn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-8f6b5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-8f6b5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8f6b5b: serviceaccount "payload-processing-e2e-worker-w4-8f6b5b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-tchdk
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8f6b5b: serviceaccount "payload-processing-e2e-worker-w4-8f6b5b" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-fc5pl

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-fc5pl

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-tchdk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-fc5pl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-tchdk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-tchdk

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-fc5pl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-fc5pl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-tchdk

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-057e2d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-057e2d
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": read tcp 10.133.0.2:58030->10.133.0.53:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": read tcp 10.133.0.2:58030->10.133.0.53:15021: read: connection reset by peer body:

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-057e2d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-057e2d-694f5f4fb5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-057e2d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-057e2d-694f5f4fb5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-057e2d: serviceaccount "payload-processing-e2e-worker-w0-057e2d" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-057e2d: serviceaccount "payload-processing-e2e-worker-w0-057e2d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-9jjs4

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-9jjs4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-d4fmr

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-057e2d-694f5f4fb5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-d4fmr

openshift-ingress

multus

payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-d4fmr

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-9jjs4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-d4fmr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-d4fmr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-9jjs4

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-9jjs4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-jn9hq

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75fd9f5d47 from 3 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b

Started

Container started
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75fd9f5d47-klw8t

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75fd9f5d47 from 4 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-75fd9f5d47-b4hfr
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

Created

Container created

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-75fd9f5d47 from 8 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-7f274

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-7f274

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-75fd9f5d47-5ks26

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-7f274

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-7f274

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-7f274

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-7f274

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

Created

Container created

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Unhealthy

Liveness probe failed: Get "https://10.133.0.32:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 2 to 3

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 6 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

Started

Container started

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

Started

Container started

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Unhealthy

Liveness probe failed: Get "https://10.133.0.32:8000/health": context deadline exceeded
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Unhealthy

Readiness probe failed: Get "https://10.133.0.32:8000/ready": context deadline exceeded

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 5 to 6

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 9 to 10

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 2 to 4
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

Unhealthy

Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-9mzcr

ProbeError

Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 6 to 7
(x6)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

Created

Container created

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 4 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

Started

Container started

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Unhealthy

Readiness probe failed: Get "https://10.133.0.32:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-18bf762c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-18bf762c

openshift-ingress

replicaset-controller

e2e-mt-18bf762c-openshift-default-77b9fdd9b5

SuccessfulCreate

Created pod: e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

openshift-ingress

deployment-controller

e2e-mt-18bf762c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-18bf762c-openshift-default-77b9fdd9b5 from 0 to 1

openshift-ingress

multus

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

ProbeError

Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

Unhealthy

Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 6 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw

Started

Container started

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 6 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-18bf762c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-18bf762c-c84588867 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-18bf762c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-18bf762c-6cc59897d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-18bf762c-6cc59897d9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-18bf762c-6cc59897d9-w4n2s
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-18bf762c-6cc59897d9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-18bf762c-6cc59897d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-18bf762c: serviceaccount "payload-processing-e2e-mt-18bf762c" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-18bf762c-c84588867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-18bf762c-c84588867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-18bf762c: serviceaccount "payload-processing-e2e-mt-18bf762c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-18bf762c-c84588867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-18bf762c-c84588867-fcv87

openshift-ingress

kubelet

payload-processing-e2e-mt-18bf762c-6cc59897d9-w4n2s

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-18bf762c-c84588867-fcv87

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-18bf762c-c84588867-fcv87

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-18bf762c-c84588867-fcv87

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-18bf762c-c84588867-fcv87

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-18bf762c-6cc59897d9-w4n2s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-18bf762c-6cc59897d9-w4n2s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-18bf762c-6cc59897d9-w4n2s

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-7f274

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-7f274

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

Unhealthy

Readiness probe failed: Get "http://10.133.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

ProbeError

Readiness probe error: Get "http://10.133.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-18bf762c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-18bf762c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-18bf762c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-18bf762c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

Started

Container started

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 7 to 9

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

Started

Container started

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-7cec02-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-7cec02-openshift-default-6fc456b49 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-7cec02-openshift-default-6fc456b49

SuccessfulCreate

Created pod: e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

openshift-ingress

gateway_labeler_controller

e2e-api-a-7cec02

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-7cec02

openshift-ingress

multus

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-7cec02

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-7cec02-64cb84f795 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7cec02-64cb84f795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-7cec02-64cb84f795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7cec02: serviceaccount "payload-processing-e2e-api-a-7cec02" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-7cec02

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-7cec02-6d95f44b95 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7cec02-6d95f44b95

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-7cec02-6d95f44b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7cec02: serviceaccount "payload-processing-e2e-api-a-7cec02" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7cec02-64cb84f795-865w7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-7cec02-6d95f44b95-wgspn

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-7cec02-64cb84f795-865w7

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7cec02-64cb84f795-865w7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7cec02-6d95f44b95

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-7cec02-6d95f44b95-wgspn

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7cec02-64cb84f795-865w7

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7cec02-64cb84f795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-7cec02-64cb84f795-865w7

openshift-ingress

kubelet

payload-processing-e2e-api-a-7cec02-6d95f44b95-wgspn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-7cec02-6d95f44b95-wgspn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-7cec02-6d95f44b95-wgspn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-a-01cbd8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-01cbd8
(x9)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-pt7dc

Unhealthy

Readiness probe failed: Get "https://10.133.0.32:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-api-a-01cbd8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-01cbd8-openshift-default-744b45f5f7 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7cec02-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7cec02-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-api-a-01cbd8-openshift-default-744b45f5f7

SuccessfulCreate

Created pod: e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 5 to 9

openshift-ingress

multus

e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

Started

Container started

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

Created

Container created

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

Started

Container started

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-01cbd8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-01cbd8-75c567cb95 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-01cbd8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-01cbd8-f74599447 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-01cbd8-f74599447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-01cbd8-f74599447-dqk2f
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-01cbd8-f74599447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-01cbd8-f74599447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-01cbd8: serviceaccount "payload-processing-e2e-api-a-01cbd8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-01cbd8-75c567cb95

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-01cbd8-75c567cb95-tpmh5
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-01cbd8-75c567cb95

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-01cbd8-75c567cb95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-01cbd8: serviceaccount "payload-processing-e2e-api-a-01cbd8" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-01cbd8-f74599447-dqk2f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-01cbd8-75c567cb95-tpmh5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-01cbd8-75c567cb95-tpmh5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-01cbd8-75c567cb95-tpmh5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-01cbd8-f74599447-dqk2f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-01cbd8-f74599447-dqk2f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-01cbd8-75c567cb95-tpmh5

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-api-a-01cbd8-f74599447-dqk2f

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 9 to 10

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-01cbd8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-01cbd8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-mt-18bf762c-openshift-default-77b9fdd9b5

SuccessfulCreate

Created pod: e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-18bf762c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-18bf762c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-18bf762c-openshift-default-77b9fdd9b5 from 1 to 2

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk

Created

Container created

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk

Started

Container started

openshift-ingress

multus

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 9 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

Created

Container created

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

Unhealthy

Readiness probe failed: Get "http://10.132.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

ProbeError

Readiness probe error: Get "http://10.132.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-a-2c70e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2c70e7-openshift-default-ccfc4b465 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-2c70e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2c70e7

openshift-ingress

replicaset-controller

e2e-api-a-2c70e7-openshift-default-ccfc4b465

SuccessfulCreate

Created pod: e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

openshift-ingress

replicaset-controller

e2e-api-a-42c96d-openshift-default-69697959d9

SuccessfulCreate

Created pod: e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq

openshift-ingress

multus

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-42c96d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-42c96d

openshift-ingress

deployment-controller

e2e-api-a-42c96d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-42c96d-openshift-default-69697959d9 from 0 to 1

openshift-ingress

multus

e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7cec02-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7cec02-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-42c96d-5696f4c5ff

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-42c96d-5696f4c5ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-42c96d: serviceaccount "payload-processing-e2e-api-a-42c96d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-42c96d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-42c96d-5696f4c5ff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-42c96d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-42c96d-65764fbd8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-42c96d-65764fbd8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-42c96d-65764fbd8c-84plq
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-42c96d-65764fbd8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-42c96d-65764fbd8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-42c96d: serviceaccount "payload-processing-e2e-api-a-42c96d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-42c96d-5696f4c5ff

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-42c96d-5696f4c5ff-bd6kc

openshift-ingress

kubelet

payload-processing-e2e-api-a-42c96d-5696f4c5ff-bd6kc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-42c96d-65764fbd8c-84plq

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-42c96d-65764fbd8c-84plq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-42c96d-5696f4c5ff-bd6kc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-42c96d-5696f4c5ff-bd6kc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-42c96d-5696f4c5ff-bd6kc

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-42c96d-65764fbd8c-84plq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-42c96d-65764fbd8c-84plq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-18bf762c-c84588867-fcv87

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-e7eea9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-e7eea9

openshift-ingress

kubelet

payload-processing-e2e-mt-18bf762c-6cc59897d9-w4n2s

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-api-b-e7eea9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-e7eea9-openshift-default-76c54449f5 from 0 to 1

openshift-ingress

multus

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-e7eea9-openshift-default-76c54449f5

SuccessfulCreate

Created pod: e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-42c96d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-42c96d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-e7eea9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-e7eea9-7699bc58bf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e7eea9-7699bc58bf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-e7eea9-7699bc58bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e7eea9: serviceaccount "payload-processing-e2e-api-b-e7eea9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e7eea9-7699bc58bf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-e7eea9-7699bc58bf-b8snr
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e7eea9: serviceaccount "payload-processing-e2e-api-b-e7eea9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7-wdd67

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-e7eea9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-e7eea9-7699bc58bf-b8snr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-e7eea9-7699bc58bf-b8snr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7-wdd67

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7-wdd67

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7-wdd67

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7-wdd67

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-e7eea9-7699bc58bf-b8snr

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-e7eea9-7699bc58bf-b8snr

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-14ca09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-14ca09

openshift-ingress

replicaset-controller

e2e-api-b-14ca09-openshift-default-659c788d6c

SuccessfulCreate

Created pod: e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

openshift-ingress

deployment-controller

e2e-api-b-14ca09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-14ca09-openshift-default-659c788d6c from 0 to 1

openshift-ingress

multus

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-f4lr4

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-f4lr4

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f4lr4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2c70e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2c70e7-5cf6795dc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7-l82mc

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2c70e7-5cf6795dc5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2c70e7-5cf6795dc5-4jsj9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2c70e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2c70e7: serviceaccount "payload-processing-e2e-api-a-2c70e7" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2c70e7-5cf6795dc5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2c70e7-5cf6795dc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2c70e7: serviceaccount "payload-processing-e2e-api-a-2c70e7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7-l82mc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7-l82mc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7-l82mc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-2c70e7-5cf6795dc5-4jsj9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-2c70e7-5cf6795dc5-4jsj9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-2c70e7-5cf6795dc5-4jsj9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-2c70e7-5cf6795dc5-4jsj9

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7-l82mc

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f4lr4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.785s (3.785s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f4lr4

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f4lr4

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f4lr4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f4lr4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-14ca09-589f7f47b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-14ca09-589f7f47b7-c9tf5

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-14ca09-59f575c7d9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-14ca09-59f575c7d9-ttflk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-14ca09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-14ca09-589f7f47b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-14ca09-589f7f47b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-14ca09-589f7f47b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-14ca09: serviceaccount "payload-processing-e2e-api-b-14ca09" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-14ca09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-14ca09-59f575c7d9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-14ca09-59f575c7d9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-14ca09-59f575c7d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-14ca09: serviceaccount "payload-processing-e2e-api-b-14ca09" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-14ca09-59f575c7d9-ttflk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-14ca09-59f575c7d9-ttflk

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-14ca09-59f575c7d9-ttflk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-14ca09-59f575c7d9-ttflk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-14ca09-589f7f47b7-c9tf5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-14ca09-589f7f47b7-c9tf5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-14ca09-589f7f47b7-c9tf5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-14ca09-589f7f47b7-c9tf5

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-01cbd8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-01cbd8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulDelete

Deleted pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulDelete

Deleted pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-mp6mx

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulDelete

Deleted pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-jfp66

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-66nr2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 10 to 7
(x5)

openshift-ingress

kubelet

e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 10 to 4

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-54bzj

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hppbk

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-ls7ft

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-whrlp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jhg75

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-jz4tz

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulDelete

Deleted pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 7 to 5

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulDelete

Deleted pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-46rnw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-qvt9t

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-42c96d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-42c96d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-bc2046

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-bc2046
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e7eea9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-b-bc2046-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-bc2046-openshift-default-577d58fbfc from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-bc2046-openshift-default-577d58fbfc

SuccessfulCreate

Created pod: e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e7eea9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2c70e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2c70e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-vf89c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-18bf762c-openshift-default-77b9fdd9b5-z7xxk

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bc2046-579d7d879

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-bc2046-579d7d879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bc2046: serviceaccount "payload-processing-e2e-api-b-bc2046" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-bc2046

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-bc2046-686fddbb8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-bc2046

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-bc2046-579d7d879 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bc2046-686fddbb8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-bc2046-686fddbb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bc2046: serviceaccount "payload-processing-e2e-api-b-bc2046" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bc2046-686fddbb8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-bc2046-686fddbb8c-mrwqg

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bc2046-579d7d879

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-bc2046-579d7d879-mkdpx

openshift-ingress

multus

payload-processing-e2e-api-b-bc2046-579d7d879-mkdpx

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bc2046-686fddbb8c-mrwqg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-bc2046-579d7d879-mkdpx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-bc2046-686fddbb8c-mrwqg

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bc2046-686fddbb8c-mrwqg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bc2046-686fddbb8c-mrwqg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-bc2046-579d7d879-mkdpx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-bc2046-579d7d879-mkdpx

Created

Container created

openshift-ingress

kubelet

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

Unhealthy

Readiness probe failed: Get "http://10.133.0.129:15021/healthz/ready": read tcp 10.133.0.2:56548->10.133.0.129:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

ProbeError

Readiness probe error: Get "http://10.133.0.129:15021/healthz/ready": read tcp 10.133.0.2:56548->10.133.0.129:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2c70e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2c70e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-7cec02-6d95f44b95-wgspn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7cec02-64cb84f795-865w7

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 10 to 5

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-8xf9w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rdlf

openshift-ingress

replicaset-controller

e2e-api-b-57ea84-openshift-default-5d444895ff

SuccessfulCreate

Created pod: e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

openshift-ingress

gateway_labeler_controller

e2e-api-b-57ea84

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-57ea84

openshift-ingress

deployment-controller

e2e-api-b-57ea84-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-57ea84-openshift-default-5d444895ff from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e7eea9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e7eea9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-lcbbl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-6wstr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-r5kjj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-57ea84-85d5768fdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-57ea84-85d5768fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-57ea84: serviceaccount "payload-processing-e2e-api-b-57ea84" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-57ea84

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-57ea84-6898c65697 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-57ea84

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-57ea84-85d5768fdc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-57ea84-6898c65697

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-57ea84-6898c65697-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-57ea84: serviceaccount "payload-processing-e2e-api-b-57ea84" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-57ea84-6898c65697

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-57ea84-6898c65697-gwhtj

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-57ea84-85d5768fdc-p58qg

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-57ea84-85d5768fdc-p58qg

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-57ea84-85d5768fdc-p58qg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-57ea84-85d5768fdc-p58qg

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-57ea84-85d5768fdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-57ea84-85d5768fdc-p58qg

openshift-ingress

kubelet

payload-processing-e2e-api-b-57ea84-6898c65697-gwhtj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-57ea84-6898c65697-gwhtj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-57ea84-6898c65697-gwhtj

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-57ea84-6898c65697-gwhtj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-01cbd8-f74599447-dqk2f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-01cbd8-75c567cb95-tpmh5

Killing

Stopping container payload-processing
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-14ca09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-14ca09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-bc2046-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-bc2046-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-7cec02-openshift-default-6fc456b49-jn9wm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-e7eea9-7699bc58bf-b8snr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e7eea9-6464f8bcd7-wdd67

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-pshh9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-br7bq

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-57ea84-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-57ea84-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-01cbd8-openshift-default-744b45f5f7-fw929

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-42c96d-5696f4c5ff-bd6kc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-42c96d-65764fbd8c-84plq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-wjw6r

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-tt9c2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-flwkb

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 8 to 5

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pj7nw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 10 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5ncdn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-27jm2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-pd66m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-14ca09-589f7f47b7-c9tf5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-14ca09-59f575c7d9-ttflk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-57ea84-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-57ea84-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-bc2046-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-bc2046-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-f6s8z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-w9jpq

openshift-ingress

deployment-controller

e2e-shared-a-w1-5e916d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5

SuccessfulCreate

Created pod: e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-5e916d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-5e916d

openshift-ingress

multus

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2c70e7-5d586ccdb7-l82mc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-2c70e7-5cf6795dc5-4jsj9

Killing

Stopping container payload-processing
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-5e916d: serviceaccount "payload-processing-e2e-shared-a-w1-5e916d" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-5e916d: serviceaccount "payload-processing-e2e-shared-a-w1-5e916d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-5e916d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-5e916d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f-hcptx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f-92nmw

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f-hcptx

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f-92nmw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f-92nmw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f-hcptx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f-hcptx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f-hcptx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f-92nmw

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f-92nmw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-e7eea9-openshift-default-76c54449f5-c6bvv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-ipp-a-9e5368-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7

SuccessfulCreate

Created pod: e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9e5368

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9e5368

openshift-ingress

multus

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-42c96d-openshift-default-69697959d9-p8ljq

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9e5368-7b876c5d49

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9e5368-7b876c5d49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9e5368: serviceaccount "payload-processing-e2e-ipp-a-9e5368" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9e5368: serviceaccount "payload-processing-e2e-ipp-a-9e5368" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9e5368

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9e5368

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9e5368-7b876c5d49 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5-g7mgs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5-g7mgs

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5-g7mgs

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5-g7mgs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5-g7mgs

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9e5368-7b876c5d49

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9e5368-7b876c5d49-4zpqb

openshift-ingress

multus

payload-processing-e2e-ipp-a-9e5368-7b876c5d49-4zpqb

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9e5368-7b876c5d49-4zpqb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9e5368-7b876c5d49-4zpqb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9e5368-7b876c5d49-4zpqb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-n2drm

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulDelete

Deleted pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 5 to 4

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

ProbeError

Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-bwbk9

Unhealthy

Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bc2046-686fddbb8c-mrwqg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-bc2046-579d7d879-mkdpx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tqjvx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulDelete

Deleted pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulDelete

Deleted pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-9qlh7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 4 to 3

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-lqvz8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-67wvj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-2c70e7-openshift-default-ccfc4b465-gc8xv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

ProbeError

Startup probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

Unhealthy

Startup probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 3 to 2

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-14ca09-openshift-default-659c788d6c-xhp9w

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-3d3023-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3d3023-openshift-default-6867c59cbf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3d3023

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3d3023

openshift-ingress

replicaset-controller

e2e-ipp-a-3d3023-openshift-default-6867c59cbf

SuccessfulCreate

Created pod: e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

openshift-ingress

multus

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-5e916d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-5e916d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-b-57ea84-6898c65697-gwhtj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-57ea84-85d5768fdc-p58qg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

ProbeError

Readiness probe error: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-2xh7r

Unhealthy

Readiness probe failed: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3d3023-78f9898c59

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3d3023-78f9898c59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3d3023: serviceaccount "payload-processing-e2e-ipp-a-3d3023" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3d3023-865744f895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3d3023-865744f895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3d3023: serviceaccount "payload-processing-e2e-ipp-a-3d3023" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3d3023-865744f895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3d3023-865744f895-8x2qn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3d3023

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3d3023-865744f895 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3d3023

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3d3023-78f9898c59 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-3d3023-78f9898c59-h98z2

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d3023-865744f895-8x2qn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d3023-865744f895-8x2qn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d3023-78f9898c59-h98z2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d3023-865744f895-8x2qn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d3023-78f9898c59-h98z2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d3023-78f9898c59-h98z2

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3d3023-78f9898c59

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3d3023-78f9898c59-h98z2

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3d3023-865744f895-8x2qn

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3d3023-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3d3023-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc

SuccessfulCreate

Created pod: e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

openshift-ingress

deployment-controller

e2e-shared-b-w1-71bc98-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-71bc98

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-71bc98

openshift-ingress

multus

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-71bc98

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-71bc98

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95-tgzcf
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-71bc98: serviceaccount "payload-processing-e2e-shared-b-w1-71bc98" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-71bc98: serviceaccount "payload-processing-e2e-shared-b-w1-71bc98" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-5e916d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7-fb4jh
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-5e916d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95-tgzcf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7-fb4jh

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7-fb4jh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7-fb4jh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7-fb4jh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95-tgzcf

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95-tgzcf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95-tgzcf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

ProbeError

Readiness probe error: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

Unhealthy

Readiness probe failed: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

Unhealthy

Startup probe failed: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

ProbeError

Startup probe error: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9e5368-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9e5368-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9e5368-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9e5368-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9e5368-7b876c5d49-4zpqb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9e5368-7f65f554f5-g7mgs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-bc2046-openshift-default-577d58fbfc-mf7p6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-99c8bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-99c8bd-openshift-default-79b8766c89 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-99c8bd-openshift-default-79b8766c89

SuccessfulCreate

Created pod: e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-99c8bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-99c8bd

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 4 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

Unhealthy

Readiness probe failed: Get "http://10.133.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

ProbeError

Readiness probe error: Get "http://10.133.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-dtxgt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-79cg6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

ProbeError

Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

Unhealthy

Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-99c8bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-99c8bd-54b85b659f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-99c8bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-99c8bd-54b85b659f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-99c8bd-54b85b659f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-99c8bd: serviceaccount "payload-processing-e2e-ipp-a-99c8bd" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-99c8bd: serviceaccount "payload-processing-e2e-ipp-a-99c8bd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-99c8bd-54b85b659f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-99c8bd-54b85b659f-9kck6

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc-tqmfm

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc-tqmfm

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-99c8bd-54b85b659f-9kck6

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-99c8bd-54b85b659f-9kck6

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc-tqmfm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-99c8bd-54b85b659f-9kck6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc-tqmfm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc-tqmfm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-99c8bd-54b85b659f-9kck6

Started

Container started

openshift-ingress

kubelet

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-53af08

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-53af08

openshift-ingress

replicaset-controller

e2e-ipp-a-53af08-openshift-default-556ff7748f

SuccessfulCreate

Created pod: e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7

openshift-ingress

multus

e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-53af08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-53af08-openshift-default-556ff7748f from 0 to 1

openshift-ingress

kubelet

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-57ea84-openshift-default-5d444895ff-8nrrp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71bc98-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71bc98-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-53af08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-53af08-6f5cbc65ff from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-53af08-6f5cbc65ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-53af08-6f5cbc65ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-53af08: serviceaccount "payload-processing-e2e-ipp-a-53af08" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-53af08-6f5cbc65ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-53af08-6f5cbc65ff-k2nmk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-53af08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9-6bbsz
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-53af08: serviceaccount "payload-processing-e2e-ipp-a-53af08" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9-6bbsz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-53af08-6f5cbc65ff-k2nmk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9-6bbsz

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9-6bbsz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9-6bbsz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-53af08-6f5cbc65ff-k2nmk

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-53af08-6f5cbc65ff-k2nmk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-53af08-6f5cbc65ff-k2nmk

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-nmdzp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9e5368

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9e5368

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9e5368-9b9c69d6 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9e5368-9b9c69d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9e5368-9b9c69d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9e5368: serviceaccount "payload-processing-e2e-ipp-a-9e5368" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9e5368: serviceaccount "payload-processing-e2e-ipp-a-9e5368" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d3023-78f9898c59-h98z2

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-dffft

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d3023-865744f895-8x2qn

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-dffft

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-2f52l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-dffft

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9e5368-9b9c69d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9e5368-9b9c69d6-t2ksv

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9e5368-9b9c69d6-t2ksv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-9e5368-9b9c69d6-t2ksv

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-dffft

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-dffft

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9e5368-9b9c69d6-t2ksv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.799s (1.799s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-dffft

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.509s (2.509s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9e5368-9b9c69d6-t2ksv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9e5368-9b9c69d6-t2ksv

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3d3023-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3d3023-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-53af08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-53af08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71bc98-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71bc98-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-447154

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-447154

openshift-ingress

replicaset-controller

e2e-ipp-b-447154-openshift-default-6584c45855

SuccessfulCreate

Created pod: e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

openshift-ingress

deployment-controller

e2e-ipp-b-447154-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-447154-openshift-default-6584c45855 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-447154-78d7bc47bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-447154-78d7bc47bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-447154: serviceaccount "payload-processing-e2e-ipp-b-447154" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-447154-56895c4795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-447154-56895c4795-7g5ff

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-447154-78d7bc47bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-447154-78d7bc47bf-gfzrx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-447154-56895c4795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-447154-56895c4795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-447154: serviceaccount "payload-processing-e2e-ipp-b-447154" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-447154

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-447154-78d7bc47bf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-447154

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-447154-56895c4795 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-447154-78d7bc47bf-gfzrx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-447154-78d7bc47bf-gfzrx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-447154-78d7bc47bf-gfzrx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-447154-78d7bc47bf-gfzrx

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-447154-56895c4795-7g5ff

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-447154-56895c4795-7g5ff

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-447154-56895c4795-7g5ff

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-447154-56895c4795-7g5ff

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3d3023

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3d3023-f7875fb5b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3d3023

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3d3023-699676b967 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3d3023-699676b967

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3d3023-699676b967-fldkz
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3d3023-f7875fb5b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3d3023-f7875fb5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3d3023: serviceaccount "payload-processing-e2e-ipp-a-3d3023" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3d3023-699676b967

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3d3023-699676b967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3d3023: serviceaccount "payload-processing-e2e-ipp-a-3d3023" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d3023-699676b967-fldkz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d3023-699676b967-fldkz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d3023-699676b967-fldkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3d3023-699676b967-fldkz

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3d3023-f7875fb5b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3d3023-f7875fb5b-hck6m

openshift-ingress

multus

payload-processing-e2e-ipp-a-3d3023-f7875fb5b-hck6m

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d3023-f7875fb5b-hck6m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d3023-f7875fb5b-hck6m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d3023-f7875fb5b-hck6m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-jb2zg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd

Unhealthy

Startup probe failed: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75fd9f5d47 from 10 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-trv8z

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-5ks26

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd

ProbeError

Startup probe error: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5ks26

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jg8xt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-5tdsb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-trv8z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-df5d0b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-df5d0b

openshift-ingress

deployment-controller

e2e-ipp-b-df5d0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-df5d0b-openshift-default-7f886b9f9 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-df5d0b-openshift-default-7f886b9f9

SuccessfulCreate

Created pod: e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-wjg8p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-df5d0b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-df5d0b-5795dbdff7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-df5d0b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-df5d0b-888475979 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df5d0b-5795dbdff7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-df5d0b-5795dbdff7-4x82m

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df5d0b-888475979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-df5d0b-888475979-kzbmv

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8af859

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8af859
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df5d0b-888475979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-df5d0b-888475979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df5d0b: serviceaccount "payload-processing-e2e-ipp-b-df5d0b" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df5d0b-5795dbdff7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-df5d0b-5795dbdff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df5d0b: serviceaccount "payload-processing-e2e-ipp-b-df5d0b" not found

openshift-ingress

multus

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-99c8bd-54b85b659f-9kck6

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-8af859-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8af859-openshift-default-59576db9cf from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-8af859-openshift-default-59576db9cf

SuccessfulCreate

Created pod: e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-df5d0b-888475979-kzbmv

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df5d0b-888475979-kzbmv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df5d0b-888475979-kzbmv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-99c8bd-77f6bdf9dc-tqmfm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df5d0b-888475979-kzbmv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df5d0b-5795dbdff7-4x82m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df5d0b-5795dbdff7-4x82m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df5d0b-5795dbdff7-4x82m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-df5d0b-5795dbdff7-4x82m

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

ProbeError

Readiness probe error: Get "http://10.133.0.168:15021/healthz/ready": read tcp 10.133.0.2:41108->10.133.0.168:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

Unhealthy

Readiness probe failed: Get "http://10.133.0.168:15021/healthz/ready": read tcp 10.133.0.2:41108->10.133.0.168:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-99c8bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8af859

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8af859-794678d7b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8af859-794678d7b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8af859-794678d7b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8af859: serviceaccount "payload-processing-e2e-ipp-b-8af859" not found
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-99c8bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8af859

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8af859-96d6c7797 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8af859-96d6c7797

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8af859-96d6c7797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8af859: serviceaccount "payload-processing-e2e-ipp-b-8af859" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8af859-794678d7b7-npqqw

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8af859-794678d7b7-npqqw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8af859-794678d7b7-npqqw

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8af859-96d6c7797

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8af859-96d6c7797-tkjx8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8af859-794678d7b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8af859-794678d7b7-npqqw

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8af859-794678d7b7-npqqw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8af859-96d6c7797-tkjx8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-8af859-96d6c7797-tkjx8

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8af859-96d6c7797-tkjx8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8af859-96d6c7797-tkjx8

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

Unhealthy

Startup probe failed: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

ProbeError

Startup probe error: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-447154-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-447154-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-53af08-59644f7dc9-6bbsz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-53af08-6f5cbc65ff-k2nmk

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-447154-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-447154-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-53af08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-53af08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-99c8bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-99c8bd-8c75c7944 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-99c8bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-99c8bd-8c75c7944

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-99c8bd-8c75c7944-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-99c8bd: serviceaccount "payload-processing-e2e-ipp-a-99c8bd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9-87s2t
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-99c8bd: serviceaccount "payload-processing-e2e-ipp-a-99c8bd" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9-87s2t

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9-87s2t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9-87s2t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9-87s2t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-99c8bd-8c75c7944

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-99c8bd-8c75c7944-76r8f

openshift-ingress

multus

payload-processing-e2e-ipp-a-99c8bd-8c75c7944-76r8f

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-baacee-openshift-default-57f845d5bf

SuccessfulDelete

Deleted pod: e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-baacee-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-baacee-openshift-default-57f845d5bf from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-baacee-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-cdtt2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-447154-78d7bc47bf-gfzrx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-447154-56895c4795-7g5ff

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-99c8bd-8c75c7944-76r8f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-99c8bd-8c75c7944-76r8f

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-99c8bd-8c75c7944-76r8f

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-53af08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-53af08-65d5bc6896 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-53af08-5f4977594c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-53af08-5f4977594c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-53af08: serviceaccount "payload-processing-e2e-ipp-a-53af08" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-53af08-65d5bc6896

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-53af08-65d5bc6896-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-53af08: serviceaccount "payload-processing-e2e-ipp-a-53af08" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-53af08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-53af08-5f4977594c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-53af08-5f4977594c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-53af08-5f4977594c-xwmrt

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-53af08-5f4977594c-xwmrt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-53af08-5f4977594c-xwmrt

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-53af08-65d5bc6896

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-53af08-65d5bc6896-8bjdx

openshift-ingress

multus

payload-processing-e2e-ipp-a-53af08-65d5bc6896-8bjdx

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-53af08-5f4977594c-xwmrt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-53af08-5f4977594c-xwmrt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-53af08-65d5bc6896-8bjdx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-53af08-65d5bc6896-8bjdx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-53af08-65d5bc6896-8bjdx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df5d0b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df5d0b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-b2d49b-openshift-default-d7d8667b7

SuccessfulCreate

Created pod: e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz

openshift-ingress

deployment-controller

e2e-ipp-b-b2d49b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b2d49b-openshift-default-d7d8667b7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b2d49b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b2d49b

openshift-ingress

multus

e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8af859-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-b-8af859-openshift-default-59576db9cf

SuccessfulCreate

Created pod: e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv

openshift-ingress

deployment-controller

e2e-ipp-b-8af859-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8af859-openshift-default-59576db9cf from 1 to 4

openshift-ingress

replicaset-controller

e2e-ipp-b-8af859-openshift-default-59576db9cf

SuccessfulCreate

Created pod: e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p

openshift-ingress

multus

e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-8af859-openshift-default-59576db9cf

SuccessfulCreate

Created pod: e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4

openshift-ingress

multus

e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

ProbeError

Readiness probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

Unhealthy

Readiness probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4

Unhealthy

Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4

ProbeError

Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p

ProbeError

Startup probe error: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p

Unhealthy

Startup probe failed: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

ProbeError

Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

Unhealthy

Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df5d0b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df5d0b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-447154

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-447154-86f756f86b from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8af859-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8af859-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-447154

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-447154-54c6dc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b2d49b-b7b76c997

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b2d49b-b7b76c997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b2d49b: serviceaccount "payload-processing-e2e-ipp-b-b2d49b" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-447154-54c6dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-447154-54c6dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-447154: serviceaccount "payload-processing-e2e-ipp-b-447154" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-447154-86f756f86b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-447154-86f756f86b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-447154: serviceaccount "payload-processing-e2e-ipp-b-447154" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b2d49b: serviceaccount "payload-processing-e2e-ipp-b-b2d49b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f-c2lr8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b2d49b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b2d49b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b2d49b-b7b76c997 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b2d49b-b7b76c997

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b2d49b-b7b76c997-5vm2r

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-447154-54c6dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-447154-54c6dc-bbxpl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f-c2lr8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2d49b-b7b76c997-5vm2r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-b2d49b-b7b76c997-5vm2r

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2d49b-b7b76c997-5vm2r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-447154-86f756f86b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-447154-86f756f86b-vqtbx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f-c2lr8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-447154-54c6dc-bbxpl

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-447154-54c6dc-bbxpl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f-c2lr8

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f-c2lr8

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2d49b-b7b76c997-5vm2r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-447154-86f756f86b-vqtbx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-b-447154-86f756f86b-vqtbx

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-447154-86f756f86b-vqtbx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.712s (1.712s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-447154-54c6dc-bbxpl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.242s (2.242s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-447154-54c6dc-bbxpl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-447154-54c6dc-bbxpl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-447154-86f756f86b-vqtbx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-447154-86f756f86b-vqtbx

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7rzxj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 2 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8af859-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8af859-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df5d0b-5795dbdff7-4x82m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df5d0b-888475979-kzbmv

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-8af859-openshift-default-59576db9cf

SuccessfulCreate

Created pod: e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6

openshift-ingress

deployment-controller

e2e-ipp-b-8af859-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8af859-openshift-default-59576db9cf from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8af859-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

multus

e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8af859-794678d7b7-npqqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8af859-96d6c7797-tkjx8

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-7f274

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-7f274

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75fd9f5d47 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-tw6gh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 2 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f4lr4

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-f4lr4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-k5bkg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75fd9f5d47 from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-jd7bn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-z5xgw

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 2 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-99c8bd-8c75c7944-76r8f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-99c8bd-b945cf7f9-87s2t

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-df5d0b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-df5d0b-f4fc9b794 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df5d0b: serviceaccount "payload-processing-e2e-ipp-b-df5d0b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-df5d0b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff-kfxnh
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df5d0b-f4fc9b794

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-df5d0b-f4fc9b794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df5d0b: serviceaccount "payload-processing-e2e-ipp-b-df5d0b" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff-kfxnh

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff-kfxnh

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-99c8bd-openshift-default-79b8766c89-nf4vd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df5d0b-f4fc9b794

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-df5d0b-f4fc9b794-c65p5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff-kfxnh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-df5d0b-f4fc9b794-c65p5

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff-kfxnh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df5d0b-f4fc9b794-c65p5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df5d0b-f4fc9b794-c65p5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df5d0b-f4fc9b794-c65p5

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8af859

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8af859-6d6894c5d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8af859

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8af859-746cb6f599 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8af859-746cb6f599

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8af859: serviceaccount "payload-processing-e2e-ipp-b-8af859" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8af859-746cb6f599

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-hh6x7
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8af859-6d6894c5d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8af859-6d6894c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8af859: serviceaccount "payload-processing-e2e-ipp-b-8af859" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-hh6x7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-hh6x7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-hh6x7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-hh6x7

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8af859-6d6894c5d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8af859-6d6894c5d-wfdlq
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-8af859-6d6894c5d-wfdlq

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8af859-6d6894c5d-wfdlq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8af859-6d6894c5d-wfdlq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8af859-6d6894c5d-wfdlq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b2d49b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b2d49b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-hh6x7

Unhealthy

Readiness probe failed: dial tcp 10.133.0.189:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3d3023-f7875fb5b-hck6m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3d3023-699676b967-fldkz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9e5368-84b68d47b7-dffft

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9e5368-9b9c69d6-t2ksv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-3d3023-openshift-default-6867c59cbf-nvmxw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-44qpc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-44qpc
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75fd9f5d47 from 4 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b2d49b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b2d49b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-9e5368-openshift-default-5ff7fc6fd7-fp6pw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df5d0b-f4fc9b794-c65p5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df5d0b-5755d869ff-kfxnh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2d49b-b7b76c997-5vm2r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2d49b-8d867f45f-c2lr8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-df5d0b-openshift-default-7f886b9f9-hflvp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-8a3796-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-8a3796-openshift-default-857c657d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-8a3796-openshift-default-857c657d9

SuccessfulCreate

Created pod: e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-8a3796

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-8a3796

openshift-ingress

multus

e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8af859-746cb6f599-hh6x7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8af859-6d6894c5d-wfdlq

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-8a3796

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-8a3796-5954d5d847 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-8a3796

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-praxis-a-8a3796-5954d5d847-c4bm9

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8a3796: serviceaccount "payload-processing-e2e-praxis-a-8a3796" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8a3796-5954d5d847

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-8a3796-5954d5d847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8a3796: serviceaccount "payload-processing-e2e-praxis-a-8a3796" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7-bjwb5

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8a3796-5954d5d847

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-8a3796-5954d5d847-c4bm9

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-zqjmv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-xq5s4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-rk9gx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-6mc8p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-8af859-openshift-default-59576db9cf-cnbq6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8a3796-5954d5d847-c4bm9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7-bjwb5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7-bjwb5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8a3796-5954d5d847-c4bm9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8a3796-5954d5d847-c4bm9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7-bjwb5

AddedInterface

Add eth0 [10.133.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7-bjwb5

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9

SuccessfulCreate

Created pod: e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-c116f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-c116f3

openshift-ingress

deployment-controller

e2e-praxis-a-c116f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c116f3-openshift-default-cf4d85cb9 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-c116f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c116f3-78c68787f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-c116f3-78c68787f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c116f3: serviceaccount "payload-processing-e2e-praxis-a-c116f3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-c116f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-c116f3-78c68787f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c116f3: serviceaccount "payload-processing-e2e-praxis-a-c116f3" not found

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75fd9f5d47 from 3 to 2

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf-rhnk6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf-rhnk6

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf-rhnk6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c116f3-78c68787f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-c116f3-78c68787f-dvczw

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf-rhnk6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf-rhnk6

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-b4hfr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c116f3-78c68787f-dvczw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c116f3-78c68787f-dvczw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-c116f3-78c68787f-dvczw

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c116f3-78c68787f-dvczw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc

SuccessfulCreate

Created pod: e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71bc98-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w1-71bc98-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc from 1 to 2

openshift-ingress

multus

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-a-c0daf4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c0daf4-openshift-default-84d68dc6f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-c0daf4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-c0daf4

openshift-ingress

replicaset-controller

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f

SuccessfulCreate

Created pod: e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55

openshift-ingress

multus

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-447154-86f756f86b-vqtbx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-447154-54c6dc-bbxpl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c116f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c116f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b2d49b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b2d49b-7d964db466 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b2d49b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b2d49b-7d964db466

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b2d49b-7d964db466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b2d49b: serviceaccount "payload-processing-e2e-ipp-b-b2d49b" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b2d49b: serviceaccount "payload-processing-e2e-ipp-b-b2d49b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-c0daf4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-c0daf4-77876767f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc-698bw
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c0daf4: serviceaccount "payload-processing-e2e-praxis-a-c0daf4" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c0daf4-77876767f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-c0daf4-77876767f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c0daf4: serviceaccount "payload-processing-e2e-praxis-a-c0daf4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-c0daf4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-k4ggk

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc-698bw

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc-698bw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c0daf4-77876767f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-c0daf4-77876767f-gc2dx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc-698bw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc-698bw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-c0daf4-77876767f-gc2dx

AddedInterface

Add eth0 [10.133.0.201/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-k4ggk

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b2d49b-7d964db466

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b2d49b-7d964db466-npfgm

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-k4ggk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-k4ggk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-b2d49b-7d964db466-npfgm

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-k4ggk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0daf4-77876767f-gc2dx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2d49b-7d964db466-npfgm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0daf4-77876767f-gc2dx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2d49b-7d964db466-npfgm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2d49b-7d964db466-npfgm

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-447154-openshift-default-6584c45855-n4z4v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0daf4-77876767f-gc2dx

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-9d7b2c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-9d7b2c

openshift-ingress

replicaset-controller

e2e-praxis-a-9d7b2c-openshift-default-76c779b789

SuccessfulCreate

Created pod: e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf

openshift-ingress

deployment-controller

e2e-praxis-a-9d7b2c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-9d7b2c-openshift-default-76c779b789 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-9d7b2c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-9d7b2c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c-7m86r

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9-djhv5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-9d7b2c: serviceaccount "payload-processing-e2e-praxis-a-9d7b2c" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-9d7b2c: serviceaccount "payload-processing-e2e-praxis-a-9d7b2c" not found

openshift-ingress

multus

payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9-djhv5

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c-7m86r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9-djhv5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9-djhv5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c-7m86r

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c-7m86r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c-7m86r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9-djhv5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8a3796-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8a3796-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9

SuccessfulCreate

Created pod: e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

openshift-ingress

replicaset-controller

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9

SuccessfulCreate

Created pod: e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

openshift-ingress

replicaset-controller

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9

SuccessfulCreate

Created pod: e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c116f3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-c116f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c116f3-openshift-default-cf4d85cb9 from 1 to 4

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

Started

Container started

openshift-ingress

multus

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8a3796-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8a3796-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

Unhealthy

Startup probe failed: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

Unhealthy

Startup probe failed: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

ProbeError

Startup probe error: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

ProbeError

Startup probe error: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj

Unhealthy

Startup probe failed: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj

ProbeError

Startup probe error: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c116f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c116f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-e59f12

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-e59f12
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55

ProbeError

Startup probe error: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-praxis-b-e59f12-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-e59f12-openshift-default-64b5cd6757 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55

Unhealthy

Startup probe failed: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-praxis-b-e59f12-openshift-default-64b5cd6757

SuccessfulCreate

Created pod: e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

openshift-ingress

multus

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-c116f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c116f3-openshift-default-cf4d85cb9 from 4 to 6

openshift-ingress

replicaset-controller

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9

SuccessfulCreate

Created pod: e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

openshift-ingress

replicaset-controller

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9

SuccessfulCreate

Created pod: e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c116f3-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

Created

Container created

openshift-ingress

multus

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-e59f12

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-e59f12

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-e59f12-7dc7465c5c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e59f12-7dc7465c5c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-e59f12-7dc7465c5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e59f12: serviceaccount "payload-processing-e2e-praxis-b-e59f12" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775-kdcph

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775-kdcph

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e59f12-7dc7465c5c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-e59f12-7dc7465c5c-25kvh
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e59f12: serviceaccount "payload-processing-e2e-praxis-b-e59f12" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e59f12-7dc7465c5c-25kvh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e59f12-7dc7465c5c-25kvh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e59f12-7dc7465c5c-25kvh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775-kdcph

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775-kdcph

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-e59f12-7dc7465c5c-25kvh

AddedInterface

Add eth0 [10.133.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775-kdcph

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

Unhealthy

Startup probe failed: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

ProbeError

Startup probe error: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-99145d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-99145d

openshift-ingress

multus

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-99145d-openshift-default-8666b49cb5

SuccessfulCreate

Created pod: e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

openshift-ingress

deployment-controller

e2e-praxis-b-99145d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-99145d-openshift-default-8666b49cb5 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c0daf4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c0daf4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-99145d-fc449dc4f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-99145d-fc449dc4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-99145d: serviceaccount "payload-processing-e2e-praxis-b-99145d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-99145d-fc449dc4f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-99145d-fc449dc4f-zmf85

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-99145d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-99145d-7d5667799 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-99145d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-99145d-fc449dc4f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-99145d-7d5667799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-99145d-7d5667799-hfvwn
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-99145d-7d5667799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-99145d-7d5667799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-99145d: serviceaccount "payload-processing-e2e-praxis-b-99145d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-99145d-7d5667799-hfvwn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-99145d-fc449dc4f-zmf85

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-99145d-7d5667799-hfvwn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-99145d-7d5667799-hfvwn

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-99145d-fc449dc4f-zmf85

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-99145d-7d5667799-hfvwn

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-99145d-fc449dc4f-zmf85

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-99145d-fc449dc4f-zmf85

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c0daf4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c0daf4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9d7b2c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9d7b2c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-cd0c98

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-cd0c98

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulCreate

Created pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

openshift-ingress

deployment-controller

e2e-praxis-b-cd0c98-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cd0c98: serviceaccount "payload-processing-e2e-praxis-b-cd0c98" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cd0c98: serviceaccount "payload-processing-e2e-praxis-b-cd0c98" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-cd0c98

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-cd0c98

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9d7b2c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-9d7b2c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc-xf68k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc-xf68k

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc-skdst

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc-xf68k

openshift-ingress

multus

payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc-skdst

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc-xf68k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc-skdst

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc-xf68k

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc-skdst

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc-skdst

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-2c0de9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-2c0de9

openshift-ingress

replicaset-controller

e2e-praxis-b-2c0de9-openshift-default-5bd7858857

SuccessfulCreate

Created pod: e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

openshift-ingress

deployment-controller

e2e-praxis-b-2c0de9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-2c0de9-openshift-default-5bd7858857 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-2c0de9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-2c0de9-f5cc7596c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-2c0de9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2c0de9: serviceaccount "payload-processing-e2e-praxis-b-2c0de9" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2c0de9-f5cc7596c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-2c0de9-f5cc7596c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2c0de9: serviceaccount "payload-processing-e2e-praxis-b-2c0de9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9-wrm5h

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-2c0de9-f5cc7596c-j6k5n

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2c0de9-f5cc7596c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-2c0de9-f5cc7596c-j6k5n

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9-wrm5h

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9-wrm5h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9-wrm5h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9-wrm5h

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2c0de9-f5cc7596c-j6k5n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2c0de9-f5cc7596c-j6k5n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2c0de9-f5cc7596c-j6k5n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

Unhealthy

Readiness probe failed: Get "http://10.133.0.210:15021/healthz/ready": read tcp 10.133.0.2:53492->10.133.0.210:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

ProbeError

Readiness probe error: Get "http://10.133.0.210:15021/healthz/ready": read tcp 10.133.0.2:53492->10.133.0.210:15021: read: connection reset by peer body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2c0de9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2c0de9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e59f12-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e59f12-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

ProbeError

Startup probe error: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

Unhealthy

Startup probe failed: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-99145d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-99145d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e59f12-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e59f12-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-praxis-b-cd0c98-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7 from 1 to 4

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulCreate

Created pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulCreate

Created pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

openshift-ingress

multus

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

AddedInterface

Add eth0 [10.133.0.218/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulCreate

Created pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

openshift-ingress

multus

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cd0c98-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

ProbeError

Readiness probe error: Get "http://10.133.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

Unhealthy

Readiness probe failed: Get "http://10.133.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

ProbeError

Startup probe error: Get "http://10.133.0.218:15021/healthz/ready": dial tcp 10.133.0.218:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

Unhealthy

Startup probe failed: Get "http://10.133.0.218:15021/healthz/ready": dial tcp 10.133.0.218:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-75fd9f5d47-klw8t

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-99145d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-99145d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-75fd9f5d47 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-75fd9f5d47

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-75fd9f5d47-klw8t
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

ProbeError

Startup probe error: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

Unhealthy

Startup probe failed: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8a3796-5954d5d847-c4bm9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8a3796-df76b56d7-bjwb5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cd0c98-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cd0c98-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

Unhealthy

Startup probe failed: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

ProbeError

Startup probe error: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c116f3-78c68787f-dvczw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c116f3-5d65cdbbcf-rhnk6

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulCreate

Created pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulCreate

Created pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

openshift-ingress

deployment-controller

e2e-praxis-b-cd0c98-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7 from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cd0c98-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

Started

Container started

openshift-ingress

multus

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

Created

Container created

openshift-ingress

multus

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2c0de9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2c0de9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w1-71bc98-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71bc98-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-lstqn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-53af08-5f4977594c-xwmrt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-53af08-65d5bc6896-8bjdx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-s2spj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2m7dx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-2k8qj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-wgfd6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-gg8ls

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-c116f3-openshift-default-cf4d85cb9-b8lrt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-8a3796-openshift-default-857c657d9-8vlxd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e59f12-7dc7465c5c-25kvh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e59f12-6cc6cd7775-kdcph

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-99145d-7d5667799-hfvwn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-99145d-fc449dc4f-zmf85

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-9d7b2c-7548d86fb9-djhv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-9d7b2c-b59bbf96c-7m86r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-9d7b2c-openshift-default-76c779b789-tvtzf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-53af08-openshift-default-556ff7748f-4nqv7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2c0de9-f5cc7596c-j6k5n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2c0de9-5f57446ff9-wrm5h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

ProbeError

Readiness probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-e59f12-openshift-default-64b5cd6757-6vxvr

Unhealthy

Readiness probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-99145d-openshift-default-8666b49cb5-dbdhq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2d49b-79df5496bc-698bw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2d49b-7d964db466-npfgm

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-b2d49b-openshift-default-d7d8667b7-69jgz

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5

SuccessfulCreate

Created pod: e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn

openshift-ingress

deployment-controller

e2e-praxis-a-3b7279-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-3b7279

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-3b7279

openshift-ingress

multus

e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn

AddedInterface

Add eth0 [10.133.0.230/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-3b7279

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-3b7279-667b9df887 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-3b7279

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc-fhmqm

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3b7279-667b9df887

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-3b7279-667b9df887-n49j9
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3b7279-667b9df887

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-3b7279-667b9df887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3b7279: serviceaccount "payload-processing-e2e-praxis-a-3b7279" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3b7279: serviceaccount "payload-processing-e2e-praxis-a-3b7279" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3b7279-667b9df887-n49j9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3b7279-667b9df887-n49j9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc-fhmqm

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc-fhmqm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc-fhmqm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc-fhmqm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-3b7279-667b9df887-n49j9

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3b7279-667b9df887-n49j9

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-2c0de9-openshift-default-5bd7858857-v5nfv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 1 to 3

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

AddedInterface

Add eth0 [10.133.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

Unhealthy

Startup probe failed: Get "http://10.133.0.236:15021/healthz/ready": dial tcp 10.133.0.236:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

ProbeError

Startup probe error: Get "http://10.133.0.236:15021/healthz/ready": dial tcp 10.133.0.236:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

Unhealthy

Startup probe failed: Get "http://10.133.0.236:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

ProbeError

Startup probe error: Get "http://10.133.0.236:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 4 to 5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l

AddedInterface

Add eth0 [10.133.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0daf4-77876767f-gc2dx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-k4ggk

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l

Unhealthy

Startup probe failed: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l

ProbeError

Startup probe error: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0daf4-77876767f-gc2dx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0daf4-fb8556c8c-k4ggk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 5 to 6

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 3 to 6

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

Started

Container started

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

AddedInterface

Add eth0 [10.133.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn

Unhealthy

Startup probe failed: Get "http://10.133.0.230:15021/healthz/ready": dial tcp 10.133.0.230:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn

ProbeError

Startup probe error: Get "http://10.133.0.230:15021/healthz/ready": dial tcp 10.133.0.230:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

ProbeError

Startup probe error: Get "http://10.133.0.248:15021/healthz/ready": dial tcp 10.133.0.248:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

Unhealthy

Startup probe failed: Get "http://10.133.0.248:15021/healthz/ready": dial tcp 10.133.0.248:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

Unhealthy

Startup probe failed: Get "http://10.133.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

ProbeError

Startup probe error: Get "http://10.133.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3b7279-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulDelete

Deleted pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

AddedInterface

Add eth0 [10.133.0.250/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulDelete

Deleted pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-hq4f7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-b-cd0c98-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7 from 6 to 4
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3b7279-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cd0c98-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulCreate

Created pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 6 to 7

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulCreate

Created pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 6 to 10
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

Unhealthy

Startup probe failed: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

Unhealthy

Readiness probe failed: Get "http://10.132.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-8k9j8

ProbeError

Readiness probe error: Get "http://10.132.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

ProbeError

Startup probe error: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf

AddedInterface

Add eth0 [10.133.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf

Started

Container started

openshift-ingress

multus

e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr

AddedInterface

Add eth0 [10.133.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-b-476ce2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c

SuccessfulCreate

Created pod: e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-476ce2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-476ce2

openshift-ingress

multus

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

Unhealthy

Startup probe failed: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

ProbeError

Startup probe error: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr

ProbeError

Startup probe error: Get "http://10.133.0.254:15021/healthz/ready": dial tcp 10.133.0.254:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-98b70c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-98b70c
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr

Unhealthy

Startup probe failed: Get "http://10.133.0.254:15021/healthz/ready": dial tcp 10.133.0.254:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-a-w0-98b70c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957

SuccessfulCreate

Created pod: e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf

Unhealthy

Startup probe failed: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf

ProbeError

Startup probe error: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3b7279-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3b7279-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-476ce2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-476ce2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-476ce2-869447977f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-476ce2-869447977f-cvzpf

AddedInterface

Add eth0 [10.133.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-476ce2-869447977f-cvzpf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-476ce2-869447977f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-476ce2-869447977f-cvzpf

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f-qgwxl
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-476ce2: serviceaccount "payload-processing-e2e-praxis-b-476ce2" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-476ce2-869447977f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-476ce2-869447977f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-476ce2: serviceaccount "payload-processing-e2e-praxis-b-476ce2" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f-qgwxl

AddedInterface

Add eth0 [10.133.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f-qgwxl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f-qgwxl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f-qgwxl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-476ce2-869447977f-cvzpf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-476ce2-869447977f-cvzpf

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-98b70c: serviceaccount "payload-processing-e2e-shared-a-w0-98b70c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-98b70c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-98b70c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-98b70c: serviceaccount "payload-processing-e2e-shared-a-w0-98b70c" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f-6lb9k

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc-vx5pq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc-vx5pq

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc-vx5pq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc-vx5pq

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f-6lb9k

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc-vx5pq

AddedInterface

Add eth0 [10.133.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f-6lb9k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f-6lb9k

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-051514

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-051514

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f-6lb9k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w3-051514-openshift-default-844c7c8789

SuccessfulCreate

Created pod: e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk

openshift-ingress

deployment-controller

e2e-shared-a-w3-051514-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-051514-openshift-default-844c7c8789 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk

AddedInterface

Add eth0 [10.133.1.3/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-051514-546778dd4c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-051514-546778dd4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-051514: serviceaccount "payload-processing-e2e-shared-a-w3-051514" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-051514

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-051514-546778dd4c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-051514

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-051514-546778dd4c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-051514-546778dd4c-vbm49

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7-pkp25
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-051514: serviceaccount "payload-processing-e2e-shared-a-w3-051514" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-051514-546778dd4c-vbm49

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-051514-546778dd4c-vbm49

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-051514-546778dd4c-vbm49

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-051514-546778dd4c-vbm49

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7-pkp25

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7-pkp25

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7-pkp25

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7-pkp25

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f

SuccessfulCreate

Created pod: e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c0daf4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-c0daf4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c0daf4-openshift-default-84d68dc6f from 1 to 2

openshift-ingress

multus

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 3 to 5

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulCreate

Created pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

openshift-ingress

multus

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

AddedInterface

Add eth0 [10.133.1.5/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-lbd4m

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

Unhealthy

Startup probe failed: Get "http://10.133.1.5:15021/healthz/ready": dial tcp 10.133.1.5:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

ProbeError

Startup probe error: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

Unhealthy

Startup probe failed: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

ProbeError

Startup probe error: Get "http://10.133.1.5:15021/healthz/ready": dial tcp 10.133.1.5:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797

SuccessfulCreate

Created pod: e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-9e3b95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-9e3b95

openshift-ingress

deployment-controller

e2e-shared-a-w2-9e3b95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

AddedInterface

Add eth0 [10.133.1.6/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-b-cd0c98-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7 from 4 to 3

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulDelete

Deleted pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dbhh9

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cd0c98-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-9e3b95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-9e3b95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-9e3b95: serviceaccount "payload-processing-e2e-shared-a-w2-9e3b95" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-9e3b95: serviceaccount "payload-processing-e2e-shared-a-w2-9e3b95" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5-llpqq

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cd0c98-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-praxis-b-cd0c98-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7 from 3 to 2

openshift-ingress

replicaset-controller

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7

SuccessfulDelete

Deleted pod: e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff-j4zz4

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff-j4zz4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff-j4zz4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff-j4zz4

AddedInterface

Add eth0 [10.133.1.7/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff-j4zz4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5-llpqq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5-llpqq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5-llpqq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5-llpqq

AddedInterface

Add eth0 [10.133.1.8/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-qt5vs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-pkq55

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c0daf4-openshift-default-84d68dc6f-g2858

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

Unhealthy

Readiness probe failed: Get "http://10.132.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

ProbeError

Readiness probe error: Get "http://10.132.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-98b70c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-98b70c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

Unhealthy

Startup probe failed: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

ProbeError

Startup probe error: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

Unhealthy

Startup probe failed: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

ProbeError

Startup probe error: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cd0c98-747b757bc-xf68k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cd0c98-7dd9d94dc-skdst

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-476ce2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-476ce2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-98b70c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-98b70c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-476ce2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-476ce2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3b7279-6884d85fbc-fhmqm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3b7279-667b9df887-n49j9

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w0-98c748-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-98c748-openshift-default-5758c954bc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-98c748

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-98c748

openshift-ingress

replicaset-controller

e2e-shared-b-w0-98c748-openshift-default-5758c954bc

SuccessfulCreate

Created pod: e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

openshift-ingress

multus

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

AddedInterface

Add eth0 [10.133.1.11/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-98c748

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-98c748-c9855bdb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899-7hrbw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-98c748

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-98c748-c9855bdb9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-98c748: serviceaccount "payload-processing-e2e-shared-b-w0-98c748" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-98c748-c9855bdb9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-k4vmp
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-98c748: serviceaccount "payload-processing-e2e-shared-b-w0-98c748" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-k4vmp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-k4vmp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899-7hrbw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899-7hrbw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899-7hrbw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899-7hrbw

AddedInterface

Add eth0 [10.133.1.12/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-k4vmp

AddedInterface

Add eth0 [10.133.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-k4vmp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-98c748-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-98c748-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

ProbeError

Startup probe error: Get "http://10.133.1.6:15021/healthz/ready": dial tcp 10.133.1.6:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

Unhealthy

Startup probe failed: Get "http://10.133.1.6:15021/healthz/ready": dial tcp 10.133.1.6:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475

SuccessfulCreate

Created pod: e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r

openshift-ingress

deployment-controller

e2e-shared-b-w3-c4d438-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475 from 0 to 1

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-5hdbz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-c4d438

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-c4d438

openshift-ingress

kubelet

e2e-praxis-b-cd0c98-openshift-default-f9ccb5df7-dtr7d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk

ProbeError

Startup probe error: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk

Unhealthy

Startup probe failed: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-051514-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-051514-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-3b7279-openshift-default-c8b5c8dd5-8dpcn

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c4d438-54dd98698f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-c4d438-54dd98698f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c4d438: serviceaccount "payload-processing-e2e-shared-b-w3-c4d438" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c4d438-54dd98698f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-c4d438-54dd98698f-vtppv
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c4d438: serviceaccount "payload-processing-e2e-shared-b-w3-c4d438" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc-r588c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-c4d438

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-c4d438

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-c4d438-54dd98698f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-c4d438-54dd98698f-vtppv

AddedInterface

Add eth0 [10.133.1.17/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c4d438-54dd98698f-vtppv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-9e3b95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc-r588c

AddedInterface

Add eth0 [10.133.1.15/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-9e3b95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc-r588c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c4d438-54dd98698f-vtppv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c4d438-54dd98698f-vtppv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc-r588c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc-r588c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-476ce2-869447977f-cvzpf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-476ce2-5fb7b9b7f-qgwxl

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-5632ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-5632ea

openshift-ingress

deployment-controller

e2e-shared-b-w2-5632ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85

SuccessfulCreate

Created pod: e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc

openshift-ingress

multus

e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc

AddedInterface

Add eth0 [10.133.1.18/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5632ea: serviceaccount "payload-processing-e2e-shared-b-w2-5632ea" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5632ea-8694dd957f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-5632ea-8694dd957f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5632ea: serviceaccount "payload-processing-e2e-shared-b-w2-5632ea" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-5632ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-5632ea-8694dd957f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-5632ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-5632ea-8694dd957f-hrfm2

AddedInterface

Add eth0 [10.133.1.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999-rv754

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5632ea-8694dd957f-hrfm2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5632ea-8694dd957f-hrfm2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5632ea-8694dd957f-hrfm2

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5632ea-8694dd957f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-5632ea-8694dd957f-hrfm2

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999-rv754

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999-rv754

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999-rv754

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999-rv754

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-051514-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-051514-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

ProbeError

Readiness probe error: Get "http://10.133.1.11:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

Unhealthy

Readiness probe failed: Get "http://10.133.1.11:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

Unhealthy

Startup probe failed: Get "http://10.133.1.11:15021/healthz/ready": dial tcp 10.133.1.11:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

ProbeError

Startup probe error: Get "http://10.133.1.11:15021/healthz/ready": dial tcp 10.133.1.11:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-476ce2-openshift-default-6df8c7ff5c-wqzzs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-98c748-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-98c748-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-5jgz8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-sbp55

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 7 to 5
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r

Unhealthy

Startup probe failed: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-c4d438-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-c4d438-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r

ProbeError

Startup probe error: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 5 to 4

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-c2vpx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5632ea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5632ea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc

Unhealthy

Startup probe failed: Get "http://10.133.1.18:15021/healthz/ready": dial tcp 10.133.1.18:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc

ProbeError

Startup probe error: Get "http://10.133.1.18:15021/healthz/ready": dial tcp 10.133.1.18:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-c4d438-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-xzn2p

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-c4d438-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5632ea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5632ea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-explicit-c4be41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c4be41

openshift-ingress

deployment-controller

e2e-explicit-c4be41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c4be41-openshift-default-686574f97c from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-c4be41-openshift-default-686574f97c

SuccessfulCreate

Created pod: e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

AddedInterface

Add eth0 [10.133.1.31/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

multus

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-j5ggr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-snlqf

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c4be41-5bd8d689f9

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c4be41-5bd8d689f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c4be41: serviceaccount "payload-processing-e2e-explicit-c4be41" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c4be41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c4be41-5bd8d689f9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c4be41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c4be41-ccb87495 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c4be41-ccb87495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c4be41-ccb87495-zm97g
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c4be41-ccb87495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c4be41-ccb87495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c4be41: serviceaccount "payload-processing-e2e-explicit-c4be41" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c4be41-ccb87495-zm97g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c4be41-5bd8d689f9

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c4be41-5bd8d689f9-4275p
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

Unhealthy

Startup probe failed: Get "http://10.133.1.31:15021/healthz/ready": dial tcp 10.133.1.31:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

ProbeError

Startup probe error: Get "http://10.133.1.31:15021/healthz/ready": dial tcp 10.133.1.31:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c4be41-ccb87495-zm97g

AddedInterface

Add eth0 [10.133.1.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-c4be41-5bd8d689f9-4275p

AddedInterface

Add eth0 [10.133.1.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-c4be41-5bd8d689f9-4275p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-c4be41-5bd8d689f9-4275p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-c4be41-5bd8d689f9-4275p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c4be41-ccb87495-zm97g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c4be41-ccb87495-zm97g

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 5 to 4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-vnjpj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 4 to 2

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-pxz92

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-4xmfp

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-bz562

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 8 to 4

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-hrtsm

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-psgmw

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-g5qrb

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulCreate

Created pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 3 to 4

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9

ProbeError

Startup probe error: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9

Unhealthy

Startup probe failed: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

Unhealthy

Readiness probe failed: Get "http://10.132.0.185:15021/healthz/ready": read tcp 10.132.0.2:43750->10.132.0.185:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

ProbeError

Readiness probe error: Get "http://10.132.0.185:15021/healthz/ready": read tcp 10.132.0.2:43750->10.132.0.185:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c4be41-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c4be41-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-lbd4m

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

Killing

Stopping container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

ProbeError

Readiness probe error: Get "http://10.134.0.103:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lbd4m

Unhealthy

Readiness probe failed: Get "http://10.134.0.103:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w2-00e840-openshift-default-59b96fb879

SuccessfulDelete

Deleted pod: e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-6fpwz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-autores-183266

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-183266

openshift-ingress

replicaset-controller

e2e-autores-183266-openshift-default-74c6876c79

SuccessfulCreate

Created pod: e2e-autores-183266-openshift-default-74c6876c79-qqthj

openshift-ingress

deployment-controller

e2e-autores-183266-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-183266-openshift-default-74c6876c79 from 0 to 1

openshift-ingress

multus

e2e-autores-183266-openshift-default-74c6876c79-qqthj

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-bv25s

openshift-ingress

replicaset-controller

e2e-worker-w3-a8e157-openshift-default-7fb96689c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-tr6nh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-a8e157-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-a8e157-openshift-default-7fb96689c7 from 3 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-a8e157-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-183266

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-183266-6b84795bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-183266-6b84795bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-183266-6b84795bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-183266: serviceaccount "payload-processing-e2e-autores-183266" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-183266

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-183266-79fdd5fc69 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-183266-79fdd5fc69

FailedCreate

Error creating: pods "payload-processing-e2e-autores-183266-79fdd5fc69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-183266: serviceaccount "payload-processing-e2e-autores-183266" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-183266-79fdd5fc69

SuccessfulCreate

Created pod: payload-processing-e2e-autores-183266-79fdd5fc69-b7g4q

openshift-ingress

multus

payload-processing-e2e-autores-183266-79fdd5fc69-b7g4q

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-183266-6b84795bc-lpxpk

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-autores-183266-6b84795bc-lpxpk

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-183266-6b84795bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-183266-6b84795bc-lpxpk

openshift-ingress

kubelet

payload-processing-e2e-autores-183266-79fdd5fc69-b7g4q

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-183266-6b84795bc-lpxpk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.981s (2.981s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-autores-183266-79fdd5fc69-b7g4q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.914s (2.914s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-183266-6b84795bc-lpxpk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-183266-6b84795bc-lpxpk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-183266-79fdd5fc69-b7g4q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-183266-79fdd5fc69-b7g4q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-c4be41-5bd8d689f9-4275p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c4be41-ccb87495-zm97g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-c4be41-openshift-default-686574f97c-phvtc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-8114c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-8114c9

openshift-ingress

kubelet

e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72

AddedInterface

Add eth0 [10.133.1.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-8114c9-openshift-default-5c444cfb5

SuccessfulCreate

Created pod: e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72

openshift-ingress

kubelet

e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72

Created

Container created

openshift-ingress

deployment-controller

e2e-noten-8114c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-8114c9-openshift-default-5c444cfb5 from 0 to 1

openshift-ingress

kubelet

e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf

SuccessfulDelete

Deleted pod: e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-057e2d-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-057e2d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf from 2 to 1

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-00e840-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w2-00e840-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-00e840-openshift-default-59b96fb879 from 3 to 1

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-q888r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-28f4l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-2xg4b

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-8114c9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-8114c9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

Unhealthy

Readiness probe failed: Get "http://10.132.0.191:15021/healthz/ready": read tcp 10.132.0.2:49370->10.132.0.191:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

ProbeError

Readiness probe error: Get "http://10.132.0.191:15021/healthz/ready": read tcp 10.132.0.2:49370->10.132.0.191:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 4 to 3

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-5qwk9

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-183266-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-183266-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8f6b5b-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-8f6b5b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8f6b5b-openshift-default-696c4598cf from 3 to 2

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf

SuccessfulDelete

Deleted pod: e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-7rblf

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-183266-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-183266-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-8114c9-openshift-default-5c444cfb5-xmg72

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-98b70c-5b8dd684bc-vx5pq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-98b70c-779f8fcd7f-6lb9k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-98b70c-openshift-default-7b4cfc957-9ntnk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-051514-546778dd4c-vbm49

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-051514-bd7d495b7-pkp25

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-k4vmp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-98c748-65f9f5d899-7hrbw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-tchdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-fc5pl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-98c748-c9855bdb9-k4vmp

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.1.13:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-shared-a-w3-051514-openshift-default-844c7c8789-wb6bk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8f6b5b-5764ddfd9f-fc5pl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8f6b5b-554fbb4c45-tchdk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c4d438-54dd98698f-vtppv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c4d438-8c7fbcfbc-r588c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-98c748-openshift-default-5758c954bc-zd4mt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-n5bfg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8f6b5b-openshift-default-696c4598cf-6xnqz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-d4fmr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-9jjs4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-c4d438-openshift-default-6d9d56f475-c995r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9e3b95-7c86c4d6ff-j4zz4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9e3b95-56f5bbddf5-llpqq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-057e2d-56fdf7f54c-9jjs4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-057e2d-694f5f4fb5-d4fmr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-183266-6b84795bc-lpxpk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-183266-79fdd5fc69-b7g4q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a8e157-69ffccd74c-z9zls

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-gvgv8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-a8e157-5597f4b787-gvgv8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-a8e157-69ffccd74c-z9zls

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-183266-openshift-default-74c6876c79-qqthj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-9e3b95-openshift-default-6cdb7fb797-kr8vl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-5e916d-b7f54ff5f-hcptx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-5e916d-df7b4777f-92nmw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5632ea-8694dd957f-hrfm2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5632ea-678cc4999-rv754

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-057e2d-openshift-default-64f8fbc7cf-hnqlw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-a8e157-openshift-default-7fb96689c7-7jd55

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-5632ea-openshift-default-5fb9d9fb85-w28vc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-5e916d-openshift-default-7f494f97b5-8mrds

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-00e840-5f5d89756f-ngbn2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-6m8q6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-71bc98-79f49cdff7-fb4jh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-71bc98-775bccfc95-tgzcf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-00e840-59cf68bb67-6m8q6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-71bc98-openshift-default-84786b6cdc-5h7hl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-00e840-openshift-default-59b96fb879-csgqb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-j2fpn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-baacee-7c84b68df5-hp4s4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-baacee-7c84b68df5-hp4s4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-baacee-6fcddb5455-j2fpn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-baacee-openshift-default-57f845d5bf-8mqsh

Killing

Stopping container istio-proxy