Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95-ldc2m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95-ldc2m to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-76c107-7c5ccc8494-w9bl2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-76c107-7c5ccc8494-w9bl2 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-025c7f-f8b9959c4-s4rtf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-025c7f-f8b9959c4-s4rtf to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-c4w2w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-c4w2w to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-8740d4-59db5fb696-7b579

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-8740d4-59db5fb696-7b579 to ip-10-0-134-193.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-q96sq

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-q96sq to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-fbfm8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-fbfm8 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-7w5vb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-7w5vb to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-873e4f54-55948f5c59-wv89h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-873e4f54-55948f5c59-wv89h to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-75d385-openshift-default-8785c777c-zt757 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-76c107-86c5c947d8-dh4hf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-76c107-86c5c947d8-dh4hf to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp to ip-10-0-135-24.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-549nm

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-549nm to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a1ee32-59995768db-lhgvn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a1ee32-59995768db-lhgvn to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-ld25h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-ld25h to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a1ee32-fd7766b56-fh9xt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a1ee32-fd7766b56-fh9xt to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-6ts5w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-6ts5w to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7 to ip-10-0-135-24.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-mnrt8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mnrt8 to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-4947s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-4947s to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c-kjpjt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c-kjpjt to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d-2fwdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d-2fwdk to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-22efcf-6bccb7db6d-gwdxh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-22efcf-6bccb7db6d-gwdxh to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2 to ip-10-0-134-193.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-v59pb

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-v59pb to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-slg62

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-slg62 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-c95gj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-c95gj to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6e0e74-56845b68bd-cgg45

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6e0e74-56845b68bd-cgg45 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d01cd5a5-8c5795c58-cgmdg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d01cd5a5-8c5795c58-cgmdg to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ea117f29-67d879c59b-wrh5r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ea117f29-67d879c59b-wrh5r to ip-10-0-134-193.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-749f59598c-gvclh

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-gvclh to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ea117f29-67d879c59b-xspsv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ea117f29-67d879c59b-xspsv to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-63499e-5dd54b859b-c22tf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-63499e-5dd54b859b-c22tf to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-4db150-679bfc745b-h5cx5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-4db150-679bfc745b-h5cx5 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-1957dc-6774bd598b-xb4k4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-1957dc-6774bd598b-xb4k4 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-0505b0-7d58478d-dqfnx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-0505b0-7d58478d-dqfnx to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-9cc0e6-6557cfd444-9ltnx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-9cc0e6-6557cfd444-9ltnx to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-d41320-6fbcbd98fb-8kmvg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d41320-6fbcbd98fb-8kmvg to ip-10-0-136-246.ec2.internal

kuadrant-system

authorino-6889cbd8c4-l8w2f

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-l8w2f to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-dntxx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-dntxx to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-4a97e9-677745666b-rgc9c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-4a97e9-677745666b-rgc9c to ip-10-0-134-193.ec2.internal

kuadrant-system

authorino-6956fb6d85-krc2x

Scheduled

Successfully assigned kuadrant-system/authorino-6956fb6d85-krc2x to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-182377-69d79f5db7-lfjhg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-182377-69d79f5db7-lfjhg to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-ddsdz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-ddsdz to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-m5qkl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-m5qkl to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-9dg75

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-9dg75 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9368ce-79658d9d7b-76tml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9368ce-79658d9d7b-76tml to ip-10-0-136-246.ec2.internal

kuadrant-system

authorino-6bd48f4-r2nh8

Scheduled

Successfully assigned kuadrant-system/authorino-6bd48f4-r2nh8 to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-5ba2ef-76df498cd6-lg7zt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-5ba2ef-76df498cd6-lg7zt to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-182377-5769fc56b6-h4sdv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-182377-5769fc56b6-h4sdv to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-8c35df-7944fdb8b6-b8xzg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-8c35df-7944fdb8b6-b8xzg to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-98f58556-75bd57c5c5-mnztm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-98f58556-75bd57c5c5-mnztm to ip-10-0-136-246.ec2.internal

kuadrant-system

authorino-6f6944bcdd-696qq

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-696qq to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd to ip-10-0-134-193.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-zgkz8 to ip-10-0-135-24.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-7vzgf

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-7vzgf to ip-10-0-135-24.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-xpssg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-xpssg to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5 to ip-10-0-134-193.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-vkjph

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vkjph to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-f9ea8f-86488b5698-727l8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-f9ea8f-86488b5698-727l8 to ip-10-0-136-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-t696w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-t696w to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-aa466d-6d4d675cf8-6gplc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-aa466d-6d4d675cf8-6gplc to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4 to ip-10-0-136-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-sjm4f to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-ca097a-868bdd8cdd-jmz5h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ca097a-868bdd8cdd-jmz5h to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-d84f47-68f6ff8b56-hrf5l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-d84f47-68f6ff8b56-hrf5l to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr to ip-10-0-136-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-rfmxm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-rfmxm to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-e954cd-699b946766-plqzh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-e954cd-699b946766-plqzh to ip-10-0-136-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-rd49z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-rd49z to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-037a5a-768dd867bc-hw9cz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-037a5a-768dd867bc-hw9cz to ip-10-0-134-193.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-77jxw

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-77jxw to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-7b7407-8575d85884-72pjq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-7b7407-8575d85884-72pjq to ip-10-0-134-193.ec2.internal

cert-manager

cert-manager-597b95cb84-pprrm

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-pprrm to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-ffbba3-79b8659d9d-wjmvq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ffbba3-79b8659d9d-wjmvq to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9a93bd-bdbb476fd-cmm5r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9a93bd-bdbb476fd-cmm5r to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-af8369-746d5899b8-zg9t9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-af8369-746d5899b8-zg9t9 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-405eb1-78879888cb-zrrpk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-405eb1-78879888cb-zrrpk to ip-10-0-134-193.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-qvm42

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-qvm42 to ip-10-0-136-246.ec2.internal

opendatahub

test-curl-11526-26aa70

Scheduled

Successfully assigned opendatahub/test-curl-11526-26aa70 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ba646b-597b979dd4-4fxpc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ba646b-597b979dd4-4fxpc to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-t7bcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-t7bcj to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-vvrg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-vvrg6 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-vqj2x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-vqj2x to ip-10-0-136-246.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-dn49h

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-dn49h to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-czsrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-czsrx to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-rv2p4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-rv2p4 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-tcp75

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-tcp75 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2 to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-xjn52

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-xjn52 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-jpx5x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-jpx5x to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-87vkq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-87vkq to ip-10-0-134-193.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7hpfd

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7hpfd to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-7a8b03-84f9f89544-dsz5l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-7a8b03-84f9f89544-dsz5l to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-derive-98f58556-f9d6f6b84-pkxqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-98f58556-f9d6f6b84-pkxqr to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-autores-037a5a-6596f65f9d-mrw4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-037a5a-6596f65f9d-mrw4g to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-pz64d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-pz64d to ip-10-0-136-246.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-fpw7s

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-fpw7s to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-7b7407-c548f9455-dth8d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-7b7407-c548f9455-dth8d to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-5k7bx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-5k7bx to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-r6vw8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-r6vw8 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-vx7jm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-vx7jm to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-bb529

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-bb529 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-f97234-c597c8447-q8xqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f97234-c597c8447-q8xqp to ip-10-0-136-246.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-759np

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-759np to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5-rmt4n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5-rmt4n to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f399fe-966c95876-z6jf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f399fe-966c95876-z6jf4 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67-dnjmt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67-dnjmt to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-vd9hg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-vd9hg to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579-znb9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579-znb9d to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-zsxww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-zsxww to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv to ip-10-0-135-24.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-bd2wm

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-bd2wm to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795-lhvr7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795-lhvr7 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f9c553-959488f9f-nvj4k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f9c553-959488f9f-nvj4k to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2 to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-a2768f-5b7fc6c6d8-cqfzn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a2768f-5b7fc6c6d8-cqfzn to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44-2jnp5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44-2jnp5 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c-gqsp8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c-gqsp8 to ip-10-0-134-193.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-tvfdn

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-tvfdn to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-f97234-69b66665f6-78mks

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f97234-69b66665f6-78mks to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6f0f50-58d7c5b446-6cwjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6f0f50-58d7c5b446-6cwjn to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7-4tnbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7-4tnbs to ip-10-0-134-193.ec2.internal

kuadrant-system

authorino-57f7f8659f-jg5vq

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-jg5vq to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9-dgnkh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9-dgnkh to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-76r22

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-76r22 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7-4hvjk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7-4hvjk to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-a121dd-646987b794-9bfdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a121dd-646987b794-9bfdk to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

Scheduled

Successfully assigned openshift-ingress/e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7-28vdh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7-28vdh to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647-l8pjc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647-l8pjc to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-76c107-59f7896687-s2tf2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-76c107-59f7896687-s2tf2 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59-xjbhm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59-xjbhm to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-e652ca-7f8745bddb-kcxfc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-e652ca-7f8745bddb-kcxfc to ip-10-0-136-246.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-9rg6h

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9rg6h to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7-xdfwc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7-xdfwc to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5-9gqk6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5-9gqk6 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk

Scheduled

Successfully assigned openshift-ingress/e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-qpthf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-qpthf to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-405eb1-7869d65754-z8bgm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-405eb1-7869d65754-z8bgm to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79-5h4j5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79-5h4j5 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-f60f16-6d7888d9c6-smv2t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f60f16-6d7888d9c6-smv2t to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc-2smdn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc-2smdn to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-hjhfm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-hjhfm to ip-10-0-134-193.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-pnkfq

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-pnkfq to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7-wp4tp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7-wp4tp to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ea117f29-85c756767f-lwk4k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ea117f29-85c756767f-lwk4k to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-87cae1-f4ff486c5-npnrr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-87cae1-f4ff486c5-npnrr to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-qxxzz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-qxxzz to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-75xkq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-75xkq to ip-10-0-136-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-qtjv7 to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g to ip-10-0-136-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-q8crv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-q8crv to ip-10-0-134-193.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-p95xn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-p95xn to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ea117f29-85c756767f-tzp9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ea117f29-85c756767f-tzp9z to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ca097a-openshift-default-7478b86885-578km to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh to ip-10-0-134-193.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-mzhxg to ip-10-0-135-24.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-ljfbp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-ljfbp to ip-10-0-134-193.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-k879q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-k879q to ip-10-0-135-24.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-9d754

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-9d754 to ip-10-0-136-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-jhgnx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-jhgnx to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-87cae1-75d9855d76-mgtst

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-87cae1-75d9855d76-mgtst to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-09ad1e-b6fbd8696-jpz2g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-09ad1e-b6fbd8696-jpz2g to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-wtbdj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-wtbdj to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v to ip-10-0-136-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-hxkhh to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9-8wgdx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9-8wgdx to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-3a236d-85d875b7fb-sbg88

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-3a236d-85d875b7fb-sbg88 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2 to ip-10-0-135-24.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-gjcgq

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-gjcgq to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf-2c9fb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf-2c9fb to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c-kddq6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c-kddq6 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-noten-f1af9c-openshift-default-695c446b69-w72kh

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f1af9c-openshift-default-695c446b69-w72kh to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ea117f29-openshift-default-7c448945-djmq5 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs to ip-10-0-135-24.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-fks52

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-fks52 to ip-10-0-136-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-f8kbm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-f8kbm to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb to ip-10-0-135-24.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-czngj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-czngj to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs to ip-10-0-135-24.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-7jlq7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-7jlq7 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9-8s6s9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9-8s6s9 to ip-10-0-136-246.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h57p9

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h57p9 to ip-10-0-134-193.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-7hbnd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-7hbnd to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-fa855c-694549449d-psnv9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fa855c-694549449d-psnv9 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-2e0e28-865bb67d4b-fvl9b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2e0e28-865bb67d4b-fvl9b to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-bg4xq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-bg4xq to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-szvh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-szvh5 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-75d385-67669b7955-t2gd5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-75d385-67669b7955-t2gd5 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f60f16-57546d5647-z6kxr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f60f16-57546d5647-z6kxr to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4561d2-56796f756c-xgkvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4561d2-56796f756c-xgkvk to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f1c4045f-6f6bd678b8-smv6j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f1c4045f-6f6bd678b8-smv6j to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-fa855c-68d9597b9b-n5cvn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fa855c-68d9597b9b-n5cvn to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql to ip-10-0-134-193.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-c6qkj

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-c6qkj to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp to ip-10-0-135-24.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-7cq2v to ip-10-0-134-193.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-77b6j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-77b6j to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5 to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9 to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8 to ip-10-0-135-24.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-57f78bcd55-28wtn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-28wtn to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8 to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9368ce-6bc4c59674-vhsbt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9368ce-6bc4c59674-vhsbt to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl to ip-10-0-135-24.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-l9js2

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-l9js2 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ait-cc59b5af-c8cb45d5d-cpdjz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-cc59b5af-c8cb45d5d-cpdjz to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a121dd-5497f8dc87-n2zbm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a121dd-5497f8dc87-n2zbm to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ait-873e4f54-84b4fdbd5d-wjtr9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-873e4f54-84b4fdbd5d-wjtr9 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f9c553-7b94f54fb-fvwz2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f9c553-7b94f54fb-fvwz2 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9-g7tf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9-g7tf9 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-bvptt

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-bvptt to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-h9q7m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-h9q7m to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-c2llr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-c2llr to ip-10-0-134-193.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9 to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55-swrq2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55-swrq2 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-4kzgq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-4kzgq to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-x5455

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-x5455 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595-6krft

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595-6krft to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t

Scheduled

Successfully assigned openshift-ingress/e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c-2fgcz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c-2fgcz to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-s7l69

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-s7l69 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-qd57l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-qd57l to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-grmdx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-grmdx to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6f0f50-668d688948-srbpl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6f0f50-668d688948-srbpl to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-wlpck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-wlpck to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-g5ppw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-g5ppw to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-hlbp6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-hlbp6 to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-667ht

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-667ht to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-h2shk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-h2shk to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-xppfw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-xppfw to ip-10-0-136-246.ec2.internal

models-as-a-service

payload-processing-external-model-5cc5856c6b-765qs

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5cc5856c6b-765qs to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-xxh4w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-xxh4w to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6-5mw9n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6-5mw9n to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf to ip-10-0-136-246.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-669569fcd5mf69c

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5mf69c to ip-10-0-135-24.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5c9d568b4f-tftjf to ip-10-0-136-246.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5c9d568b4f-pk4zs to ip-10-0-134-193.ec2.internal

models-as-a-service

payload-processing-external-model-6fdcbd645b-d9lrk

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6fdcbd645b-d9lrk to ip-10-0-135-24.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5c9d568b4f-j4rwb to ip-10-0-135-24.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-rcx5n

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-rcx5n to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-rn6ng

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-rn6ng to ip-10-0-134-193.ec2.internal

openshift-ingress

router-default-77bb4759d7-ztvnj

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-77bb4759d7-ztvnj

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-77bb4759d7-ztvnj

Scheduled

Successfully assigned openshift-ingress/router-default-77bb4759d7-ztvnj to ip-10-0-135-24.ec2.internal

opendatahub

test-curl-11535-e19d44

Scheduled

Successfully assigned opendatahub/test-curl-11535-e19d44 to ip-10-0-136-246.ec2.internal

models-as-a-service

payload-processing-external-model-797f94cb56-9wjnt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-797f94cb56-9wjnt to ip-10-0-134-193.ec2.internal

opendatahub

test-curl-11535-cc7e99

Scheduled

Successfully assigned opendatahub/test-curl-11535-cc7e99 to ip-10-0-136-246.ec2.internal

opendatahub

test-curl-11532-b7e03c

Scheduled

Successfully assigned opendatahub/test-curl-11532-b7e03c to ip-10-0-134-193.ec2.internal

opendatahub

test-curl-11532-b7a498

Scheduled

Successfully assigned opendatahub/test-curl-11532-b7a498 to ip-10-0-136-246.ec2.internal

openshift-jobset-operator

jobset-controller-manager-69cd49d574-qj754

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-69cd49d574-qj754 to ip-10-0-136-246.ec2.internal

opendatahub

test-curl-11532-8efc6a

Scheduled

Successfully assigned opendatahub/test-curl-11532-8efc6a to ip-10-0-136-246.ec2.internal

opendatahub

test-curl-11532-8333e1

Scheduled

Successfully assigned opendatahub/test-curl-11532-8333e1 to ip-10-0-136-246.ec2.internal

opendatahub

test-curl-11532-7b026e

Scheduled

Successfully assigned opendatahub/test-curl-11532-7b026e to ip-10-0-136-246.ec2.internal

models-as-a-service

payload-processing-external-model-7f64b5b66-lh4pd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7f64b5b66-lh4pd to ip-10-0-136-246.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-rvf99

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-rvf99 to ip-10-0-136-246.ec2.internal

opendatahub

test-curl-11532-5e1c6e

Scheduled

Successfully assigned opendatahub/test-curl-11532-5e1c6e to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-nmcmp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-nmcmp to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-9jmmc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-9jmmc to ip-10-0-134-193.ec2.internal

models-as-a-service

payload-processing-external-model-7f64b5b66-rhn46

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7f64b5b66-rhn46 to ip-10-0-134-193.ec2.internal

opendatahub

test-curl-11526-de39c3

Scheduled

Successfully assigned opendatahub/test-curl-11526-de39c3 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b to ip-10-0-134-193.ec2.internal

opendatahub

test-curl-11526-85778e

Scheduled

Successfully assigned opendatahub/test-curl-11526-85778e to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4561d2-6dc4f865fb-rmvnd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4561d2-6dc4f865fb-rmvnd to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-517a25-67d96956bb-p7jgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-517a25-67d96956bb-p7jgq to ip-10-0-136-246.ec2.internal

opendatahub

odh-model-controller-769875db56-zm28s

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-zm28s to ip-10-0-135-24.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-bt6xn

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-bt6xn to ip-10-0-135-24.ec2.internal

opendatahub

maas-controller-85cd47f586-hfkxp

Scheduled

Successfully assigned opendatahub/maas-controller-85cd47f586-hfkxp to ip-10-0-135-24.ec2.internal

models-as-a-service

payload-processing-external-model-947b6b675-9k2tf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-947b6b675-9k2tf to ip-10-0-134-193.ec2.internal

opendatahub

maas-controller-7ddfbb87d4-bkzx2

Scheduled

Successfully assigned opendatahub/maas-controller-7ddfbb87d4-bkzx2 to ip-10-0-136-246.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-8mvtq

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-8mvtq to ip-10-0-135-24.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-2ln8c

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-2ln8c to ip-10-0-135-24.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-gr5gq

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-gr5gq to ip-10-0-134-193.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-j7qpr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-j7qpr to ip-10-0-134-193.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-mp6wv

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-mp6wv to ip-10-0-135-24.ec2.internal

opendatahub

ai-gateway-controller-8489fb66bd-4jwwm

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-8489fb66bd-4jwwm to ip-10-0-134-193.ec2.internal

models-as-a-service

payload-processing-external-model-c56dbf545-9hp6z

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-c56dbf545-9hp6z to ip-10-0-136-246.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-ccqqn

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-ccqqn to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6 to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7 to ip-10-0-135-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5-rhb58

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5-rhb58 to ip-10-0-136-246.ec2.internal

openshift-ingress

kube-auth-proxy-59688578c6-wtg9m

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59688578c6-wtg9m to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6 to ip-10-0-136-246.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-bc2h7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-bc2h7 to ip-10-0-134-193.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47-8wdvj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47-8wdvj to ip-10-0-136-246.ec2.internal

models-as-a-service

payload-processing-external-model-cdc946f8b-kw469

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-cdc946f8b-kw469 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7 to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn to ip-10-0-134-193.ec2.internal

models-as-a-service

payload-processing-external-model-cdc946f8b-psdq4

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-cdc946f8b-psdq4 to ip-10-0-134-193.ec2.internal

openshift-ingress

kube-auth-proxy-59688578c6-ds4tj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59688578c6-ds4tj to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-bpv9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-bpv9d to ip-10-0-136-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-aa466d-7d69848679-w2mcg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-aa466d-7d69848679-w2mcg to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf to ip-10-0-136-246.ec2.internal

openshift-ingress

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl to ip-10-0-135-24.ec2.internal

openshift-ingress

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8 to ip-10-0-135-24.ec2.internal

models-as-a-service

payload-processing-external-model-d654b97b9-6dss4

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d654b97b9-6dss4 to ip-10-0-134-193.ec2.internal

openshift-ingress

e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7 to ip-10-0-136-246.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-77bb4759d7 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-77bb4759d7

SuccessfulCreate

Created pod: router-default-77bb4759d7-ztvnj
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-77bb4759d7-ztvnj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-77bb4759d7-ztvnj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x2)

openshift-ingress

kubelet

router-default-77bb4759d7-ztvnj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-77bb4759d7-ztvnj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-77bb4759d7-ztvnj

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-77bb4759d7-ztvnj

Created

Container created

openshift-ingress

kubelet

router-default-77bb4759d7-ztvnj

Started

Container started

openshift-ingress

multus

router-default-77bb4759d7-ztvnj

AddedInterface

Add eth0 [10.132.0.8/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-bc2h7

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-bc2h7

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bc2h7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bc2h7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.084s (3.084s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bc2h7

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bc2h7

Started

Container started

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-749f59598c from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-749f59598c

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-749f59598c-gvclh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-zgkz8

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-57f78bcd55 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-749f59598c-gvclh

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-749f59598c-gvclh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.117s (8.117s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-749f59598c-gvclh

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-749f59598c-gvclh

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-749f59598c-gvclh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.405s (8.405s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5c9d568b4f

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5c9d568b4f-tftjf

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5c9d568b4f

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-5c9d568b4f from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5c9d568b4f

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.705s (2.705s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.25s (3.25s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.59s (2.59s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

Started

Container started

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-rvf99

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 278ms (278ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 308ms (308ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-j4rwb

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: waiting for spec update of deployment "jobset-operator" to be observed...

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 259ms (259ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c9d568b4f-tftjf

Started

Container started

opendatahub-operator-system

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs_96217665-eb43-4761-a3e4-a323317fcbac

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-5c9d568b4f-pk4zs_96217665-eb43-4761-a3e4-a323317fcbac became leader
(x3)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-rvf99

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rvf99

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-42btx

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rvf99

Started

Container started
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rvf99

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rvf99

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.343s (2.343s including waiting). Image size: 224874686 bytes.
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-rvf99_5b3bdfe6-962f-4869-b606-69bca67480d1 became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-tvfdn

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-tvfdn

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-tvfdn

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-q96sq

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-tvfdn

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-tvfdn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.117s (2.117s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-tvfdn

Started

Container started

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-q96sq

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-q96sq

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

limitador-operator-controller-manager-5778bb4449-tvfdn_b46ee7c3-b935-4b99-b02a-b4f5d2b7a494

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-tvfdn_b46ee7c3-b935-4b99-b02a-b4f5d2b7a494 became leader
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-549nm

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-549nm

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-549nm

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-fpw7s

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fpw7s

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-fpw7s

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-pprrm

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-q96sq

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-pprrm

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 527ms (527ms including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-q96sq

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-pprrm

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

kubelet

cert-manager-597b95cb84-pprrm

Created

Container created

cert-manager

multus

cert-manager-597b95cb84-pprrm

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-pprrm

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-q96sq

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 7.268s (7.268s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-549nm

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.689s (3.689s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-549nm

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-549nm

Started

Container started

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-7vzgf

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fpw7s

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fpw7s

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fpw7s

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.539s (3.539s including waiting). Image size: 424244516 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-fpw7s_f2f45628-8c33-450f-99d1-2f6abbdd8fe5

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-fpw7s_f2f45628-8c33-450f-99d1-2f6abbdd8fe5 became leader

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-7vzgf

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-7vzgf

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-7vzgf

Started

Container started

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-669569fcd5mf69c

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-669569fcd5

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-669569fcd5mf69c

openshift-ingress

replicaset-controller

kube-auth-proxy-59688578c6

SuccessfulCreate

Created pod: kube-auth-proxy-59688578c6-ds4tj

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-59688578c6 from 0 to 2

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-669569fcd5 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

kuadrant-system

authorino-operator-7b7bb4bc77-7vzgf_c8a5711c-ccb3-40d0-a126-9fe396a72ab4

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-7vzgf_c8a5711c-ccb3-40d0-a126-9fe396a72ab4 became leader

openshift-ingress

multus

kube-auth-proxy-59688578c6-wtg9m

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-7vzgf

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

multus

kube-auth-proxy-59688578c6-ds4tj

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-59688578c6-ds4tj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

replicaset-controller

kube-auth-proxy-59688578c6

SuccessfulCreate

Created pod: kube-auth-proxy-59688578c6-wtg9m

openshift-ingress

kubelet

kube-auth-proxy-59688578c6-wtg9m

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-7vzgf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.068s (1.068s including waiting). Image size: 167738465 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-669569fcd5mf69c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-669569fcd5mf69c

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-669569fcd5mf69c

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

openshift-ingress

kubelet

kube-auth-proxy-59688578c6-ds4tj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.214s (2.214s including waiting). Image size: 188904677 bytes.

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-77jxw

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-77jxw

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-77jxw

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-59688578c6-ds4tj

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-59688578c6-wtg9m

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-59688578c6-wtg9m

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-59688578c6-wtg9m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.312s (2.312s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59688578c6-ds4tj

Started

Container started

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-gr5gq

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-gr5gq

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-gr5gq

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

dns-operator-controller-manager-8557cbdb84-77jxw_45da0860-c08a-4955-a97d-fea806a770d4

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-77jxw_45da0860-c08a-4955-a97d-fea806a770d4 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-77jxw

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-77jxw

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-77jxw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.411s (2.411s including waiting). Image size: 190804149 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-gr5gq

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-gr5gq

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-gr5gq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.233s (1.233s including waiting). Image size: 195729000 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

opendatahub

kserve-module-controller-manager-7566cf5fc8-gr5gq_1ed008b9-58c0-4053-8479-e562f6278ab1

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-gr5gq_1ed008b9-58c0-4053-8479-e562f6278ab1 became leader

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-wjn6d"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-jq4fr"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-69cd49d574

SuccessfulCreate

Created pod: jobset-controller-manager-69cd49d574-qj754

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-69cd49d574 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

kubelet

jobset-controller-manager-69cd49d574-qj754

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-69cd49d574-qj754

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

kubelet

jobset-controller-manager-69cd49d574-qj754

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-69cd49d574-qj754

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.896s (2.896s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-69cd49d574-qj754

Started

Container started

openshift-jobset-operator

jobset-controller-manager-69cd49d574-qj754_8e05223b-8b33-4065-a8ab-99d8a1b3bac3

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-69cd49d574-qj754_8e05223b-8b33-4065-a8ab-99d8a1b3bac3 became leader

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-j7qpr

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-j7qpr

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-mp6wv

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-bt6xn

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-zm28s

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j7qpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j7qpr

Started

Container started

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-8mvtq

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j7qpr

Created

Container created

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

kubelet

kserve-controller-manager-776cc66d47-mp6wv

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-bc2h7

Killing

Stopping container discovery

opendatahub

multus

odh-model-controller-769875db56-zm28s

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-8mvtq

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-8mvtq

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-bc2h7

opendatahub

kubelet

model-serving-api-75bd89fdfc-bt6xn

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

model-serving-api-75bd89fdfc-bt6xn

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-zm28s

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

kserve-controller-manager-776cc66d47-mp6wv

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-bt6xn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.993s (2.993s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-bt6xn

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-bt6xn

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-zm28s

Created

Container created

opendatahub

odh-model-controller-769875db56-zm28s_00598b4d-b1db-4939-bb5f-26c25c9aa58b

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-zm28s_00598b4d-b1db-4939-bb5f-26c25c9aa58b became leader

opendatahub

kubelet

odh-model-controller-769875db56-zm28s

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-mp6wv

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.358s (4.358s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-mp6wv

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-8mvtq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 4.302s (4.302s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-8mvtq

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-8mvtq

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-mp6wv

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-zm28s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.919s (3.919s including waiting). Image size: 236755567 bytes.

opendatahub

llmisvc-controller-manager-869d5dcc5d-8mvtq_13258d3d-d9e7-49e7-8f12-1ac7f714d99e

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-8mvtq_13258d3d-d9e7-49e7-8f12-1ac7f714d99e became leader

opendatahub

kserve-controller-manager-776cc66d47-mp6wv_d3b38c9b-01bd-43e0-8c70-bec513d07d48

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-mp6wv_d3b38c9b-01bd-43e0-8c70-bec513d07d48 became leader
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fpw7s

Killing

Stopping container manager

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-7hpfd

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7hpfd

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-7hpfd

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7hpfd

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7hpfd

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-dn49h

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-759np

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7hpfd_0d3c0874-8235-4693-b9ad-07c5fbf49d60

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-7hpfd_0d3c0874-8235-4693-b9ad-07c5fbf49d60 became leader

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dn49h

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-dn49h

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

multus

limitador-limitador-74dfcfb894-759np

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-759np

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-jg5vq

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-bd2wm

Pulled

Container image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-759np

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-v59pb

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

limitador-limitador-7c9b87d574-bd2wm

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kuadrant-system

multus

authorino-56c6c9ddd5-v59pb

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-jg5vq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-jg5vq

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-bd2wm

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-759np

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-v59pb

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-759np

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.214s (1.215s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-bd2wm

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-bd2wm

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-jg5vq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.59s (1.59s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-v59pb

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-jg5vq

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-jg5vq

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-v59pb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.628s (1.628s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-v59pb

Started

Container started

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-jg5vq

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-jg5vq

Killing

Stopping container authorino

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dn49h

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dn49h

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dn49h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.537s (4.537s including waiting). Image size: 342538866 bytes.

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-759np

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-759np

opendatahub

multus

maas-controller-85cd47f586-hfkxp

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7ddfbb87d4 from 0 to 1

opendatahub

kubelet

maas-controller-85cd47f586-hfkxp

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:1493e15edfa65933afdabf49c13c5aa40339d9239165faf556aee116b7e027dc"

opendatahub

replicaset-controller

maas-controller-7ddfbb87d4

SuccessfulCreate

Created pod: maas-controller-7ddfbb87d4-bkzx2

opendatahub

replicaset-controller

maas-controller-85cd47f586

SuccessfulCreate

Created pod: maas-controller-85cd47f586-hfkxp

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-85cd47f586 from 0 to 1

opendatahub

kubelet

maas-controller-7ddfbb87d4-bkzx2

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:1493e15edfa65933afdabf49c13c5aa40339d9239165faf556aee116b7e027dc"

opendatahub

multus

maas-controller-7ddfbb87d4-bkzx2

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7ddfbb87d4-bkzx2

Started

Container started

opendatahub

kubelet

maas-controller-7ddfbb87d4-bkzx2

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:1493e15edfa65933afdabf49c13c5aa40339d9239165faf556aee116b7e027dc" in 2.291s (2.291s including waiting). Image size: 200053246 bytes.

opendatahub

kubelet

maas-controller-7ddfbb87d4-bkzx2

Created

Container created

opendatahub

kubelet

maas-controller-85cd47f586-hfkxp

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:1493e15edfa65933afdabf49c13c5aa40339d9239165faf556aee116b7e027dc" in 2.457s (2.457s including waiting). Image size: 200053246 bytes.

opendatahub

kubelet

maas-controller-85cd47f586-hfkxp

Created

Container created

opendatahub

kubelet

maas-controller-85cd47f586-hfkxp

Started

Container started

opendatahub

maas-controller-85cd47f586-hfkxp_87c44572-313a-496f-b6c7-a796f3d2f48b

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-85cd47f586-hfkxp_87c44572-313a-496f-b6c7-a796f3d2f48b became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-rcx5n

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rcx5n

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-rcx5n

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-85cd47f586 from 1 to 0

opendatahub

replicaset-controller

maas-controller-85cd47f586

SuccessfulDelete

Deleted pod: maas-controller-85cd47f586-hfkxp

opendatahub

kubelet

maas-controller-85cd47f586-hfkxp

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rcx5n

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rcx5n

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rcx5n

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 11.502s (11.502s including waiting). Image size: 1089502687 bytes.

opendatahub

maas-controller-7ddfbb87d4-bkzx2_afa9f67a-7279-4e84-a7d4-50e3127bb20f

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7ddfbb87d4-bkzx2_afa9f67a-7279-4e84-a7d4-50e3127bb20f became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6bd48f4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-696qq

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-696qq

kuadrant-system

replicaset-controller

authorino-6bd48f4

SuccessfulCreate

Created pod: authorino-6bd48f4-r2nh8

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-l8w2f

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-l8w2f

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

Started

Container started

kuadrant-system

kubelet

authorino-6bd48f4-r2nh8

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

Created

Container created

kuadrant-system

kubelet

authorino-6bd48f4-r2nh8

Started

Container started

kuadrant-system

multus

authorino-6bd48f4-r2nh8

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6bd48f4-r2nh8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 401ms (401ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6bd48f4-r2nh8

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-56c6c9ddd5-v59pb

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-v59pb

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-2ln8c

opendatahub

multus

llmisvc-controller-manager-6466c554d8-2ln8c

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-2ln8c

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-2ln8c

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-2ln8c

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-2ln8c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 293ms (293ms including waiting). Image size: 235100981 bytes.

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-7cq2v

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-hxkhh

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-57f78bcd55 from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-sjm4f

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.365s (2.365s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.905s (2.905s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.886s (2.886s including waiting). Image size: 183555333 bytes.
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

ProbeError

Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

Unhealthy

Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-8mvtq

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-8mvtq

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-ccqqn

opendatahub

multus

ai-gateway-controller-7d85675f98-ccqqn

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-ccqqn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-ccqqn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.543s (1.543s including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-ccqqn

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-ccqqn

Created

Container created

opendatahub

ai-gateway-controller-7d85675f98-ccqqn_43f97776-12b9-4075-9325-176be5ddd312

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-ccqqn_43f97776-12b9-4075-9325-176be5ddd312 became leader

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-ld25h

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-ld25h

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-ld25h

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

multus

payload-processing-5f78687d5b-bvptt

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-bvptt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-bvptt

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-ld25h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-ld25h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.168s (2.168s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-bvptt

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-bvptt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.164s (2.164s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-bvptt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-ld25h

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-mzhxg

opendatahub

llmisvc-controller-manager-6466c554d8-2ln8c_7fae67a0-03b3-475f-8c77-20474a2936b6

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-2ln8c_7fae67a0-03b3-475f-8c77-20474a2936b6 became leader

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-rd49z

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-rd49z

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

Created

Container created

opendatahub

replicaset-controller

ai-gateway-controller-8489fb66bd

SuccessfulCreate

Created pod: ai-gateway-controller-8489fb66bd-4jwwm

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-8489fb66bd from 0 to 1

opendatahub

kubelet

ai-gateway-controller-8489fb66bd-4jwwm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 387ms (387ms including waiting). Image size: 183888297 bytes.

opendatahub

multus

ai-gateway-controller-8489fb66bd-4jwwm

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-8489fb66bd-4jwwm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-8489fb66bd-4jwwm

Started

Container started

opendatahub

kubelet

ai-gateway-controller-8489fb66bd-4jwwm

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

opendatahub

kubelet

ai-gateway-controller-7d85675f98-ccqqn

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-ccqqn

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-9rg6h

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-9rg6h

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-9rg6h

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-9rg6h

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-9rg6h

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-9rg6h

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.357s (1.357s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-pnkfq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-pnkfq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 216ms (216ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-pnkfq

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-pnkfq

Started

Container started

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-pnkfq

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-pnkfq

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

opendatahub

ai-gateway-controller-8489fb66bd-4jwwm_503f2efb-7ba9-4c07-8360-c1c76dee733e

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-8489fb66bd-4jwwm_503f2efb-7ba9-4c07-8360-c1c76dee733e became leader

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-9d754

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-9d754

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-9d754

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-9d754

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-9d754

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-9d754

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.385s (1.385s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-gjcgq

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-gjcgq

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-gjcgq

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-gjcgq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 173ms (173ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-gjcgq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-gjcgq

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h57p9

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h57p9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h57p9

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h57p9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 226ms (226ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h57p9

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8h57p9

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-c6qkj

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

multus

echo-simulator-kserve-64b6f8f96c-c6qkj

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c6qkj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c6qkj

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c6qkj

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-c6qkj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.911s (1.911s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-l9js2

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-l9js2

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 213ms (213ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-l9js2

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-l9js2

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-l9js2

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-l9js2

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 235ms (235ms including waiting). Image size: 98346788 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-t696w

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-fks52

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-fks52

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-t696w

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-qvm42

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-qtjv7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-qvm42

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qvm42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qvm42

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qvm42

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

Created

Container created

kuadrant-system

multus

authorino-6956fb6d85-krc2x

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6956fb6d85-krc2x

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6956fb6d85

SuccessfulCreate

Created pod: authorino-6956fb6d85-krc2x

kuadrant-system

kubelet

authorino-6956fb6d85-krc2x

Started

Container started

kuadrant-system

kubelet

authorino-6956fb6d85-krc2x

Created

Container created

kuadrant-system

kubelet

authorino-6956fb6d85-krc2x

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 613ms (613ms including waiting). Image size: 204096810 bytes.
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-6bd48f4 from 1 to 0

kuadrant-system

replicaset-controller

authorino-6bd48f4

SuccessfulDelete

Deleted pod: authorino-6bd48f4-r2nh8

kuadrant-system

kubelet

authorino-6bd48f4-r2nh8

Killing

Stopping container authorino
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qvm42

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qvm42

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ait-cc59b5af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-cc59b5af-openshift-default-6fcc8f67b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-fb8b5ba5-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-fb8b5ba5-gw

openshift-ingress

deployment-controller

e2e-ait-f1c4045f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f1c4045f-openshift-default-85f8967bbc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f1c4045f-openshift-default-85f8967bbc

SuccessfulCreate

Created pod: e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

openshift-ingress

gateway_labeler_controller

e2e-ait-cc59b5af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-cc59b5af

openshift-ingress

replicaset-controller

e2e-ait-cc59b5af-openshift-default-6fcc8f67b5

SuccessfulCreate

Created pod: e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t

openshift-ingress

gateway_labeler_controller

e2e-ait-f1c4045f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f1c4045f

openshift-ingress

multus

e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-fb8b5ba5-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5 from 0 to 1

openshift-ingress

multus

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5

SuccessfulCreate

Created pod: e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

openshift-ingress

gateway_labeler_controller

e2e-ait-873e4f54

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-873e4f54

openshift-ingress

multus

e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-873e4f54-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-873e4f54-openshift-default-5bd9df9c57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-873e4f54-openshift-default-5bd9df9c57

SuccessfulCreate

Created pod: e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5-9gqk6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-fb8b5ba5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fb8b5ba5: serviceaccount "payload-processing-e2e-migrate-fb8b5ba5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-fb8b5ba5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-4947s
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fb8b5ba5: serviceaccount "payload-processing-e2e-migrate-fb8b5ba5" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-4947s

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-4947s

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5-9gqk6

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5-9gqk6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5-9gqk6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5-9gqk6

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-cc59b5af-c8cb45d5d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-cc59b5af-c8cb45d5d-cpdjz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-cc59b5af-c8cb45d5d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-cc59b5af-c8cb45d5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-cc59b5af: serviceaccount "payload-processing-e2e-ait-cc59b5af" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-cc59b5af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-cc59b5af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-cc59b5af-c8cb45d5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c-kjpjt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-cc59b5af: serviceaccount "payload-processing-e2e-ait-cc59b5af" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f1c4045f-6f6bd678b8

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f1c4045f-6f6bd678b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f1c4045f: serviceaccount "payload-processing-e2e-ait-f1c4045f" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-cc59b5af-c8cb45d5d-cpdjz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-cc59b5af-c8cb45d5d-cpdjz

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c-kjpjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f1c4045f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f1c4045f-6f6bd678b8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-4947s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.069s (2.069s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c-kjpjt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-cc59b5af-c8cb45d5d-cpdjz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-4947s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-4947s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-cc59b5af-c8cb45d5d-cpdjz

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f1c4045f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f1c4045f-6f6bd678b8

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f1c4045f-6f6bd678b8-smv6j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-c95gj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f1c4045f: serviceaccount "payload-processing-e2e-ait-f1c4045f" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c-kjpjt

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c-kjpjt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-c95gj

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-f1c4045f-6f6bd678b8-smv6j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-f1c4045f-6f6bd678b8-smv6j

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-c95gj

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f1c4045f-6f6bd678b8-smv6j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-derive-98f58556-openshift-default-578678f5b9

SuccessfulCreate

Created pod: e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

openshift-ingress

deployment-controller

e2e-derive-98f58556-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-98f58556-openshift-default-578678f5b9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-f1c4045f-6f6bd678b8-smv6j

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-98f58556

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-98f58556

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-873e4f54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-873e4f54-55948f5c59 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-873e4f54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-873e4f54-84b4fdbd5d from 0 to 1

openshift-ingress

multus

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-873e4f54-55948f5c59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-873e4f54-55948f5c59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-873e4f54: serviceaccount "payload-processing-e2e-ait-873e4f54" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-c95gj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.312s (2.312s including waiting). Image size: 125317101 bytes.

openshift-ingress

multus

payload-pre-processing-e2e-ait-873e4f54-55948f5c59-wv89h

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-873e4f54-55948f5c59-wv89h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-873e4f54-55948f5c59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-873e4f54-55948f5c59-wv89h

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-c95gj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-c95gj

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-873e4f54-84b4fdbd5d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-873e4f54-84b4fdbd5d-wjtr9
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-873e4f54-84b4fdbd5d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-873e4f54-84b4fdbd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-873e4f54: serviceaccount "payload-processing-e2e-ait-873e4f54" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-873e4f54-84b4fdbd5d-wjtr9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-873e4f54-84b4fdbd5d-wjtr9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-873e4f54-84b4fdbd5d-wjtr9

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-873e4f54-84b4fdbd5d-wjtr9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-873e4f54-55948f5c59-wv89h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-873e4f54-55948f5c59-wv89h

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-98f58556-f9d6f6b84

FailedCreate

Error creating: pods "payload-processing-e2e-derive-98f58556-f9d6f6b84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-98f58556: serviceaccount "payload-processing-e2e-derive-98f58556" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-98f58556-f9d6f6b84

SuccessfulCreate

Created pod: payload-processing-e2e-derive-98f58556-f9d6f6b84-pkxqr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-98f58556-75bd57c5c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-98f58556-75bd57c5c5-mnztm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-98f58556-75bd57c5c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-98f58556-75bd57c5c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-98f58556: serviceaccount "payload-processing-e2e-derive-98f58556" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-98f58556

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-98f58556-75bd57c5c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-98f58556

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-98f58556-f9d6f6b84 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-98f58556-75bd57c5c5-mnztm

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-cc59b5af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-98f58556-f9d6f6b84-pkxqr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-98f58556-f9d6f6b84-pkxqr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-98f58556-75bd57c5c5-mnztm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-98f58556-75bd57c5c5-mnztm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-derive-98f58556-f9d6f6b84-pkxqr

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-98f58556-f9d6f6b84-pkxqr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-98f58556-75bd57c5c5-mnztm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-cc59b5af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-873e4f54-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-873e4f54-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

Unhealthy

Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

ProbeError

Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-cc59b5af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f1c4045f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f1c4045f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-cc59b5af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-fb8b5ba5-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-fb8b5ba5-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-873e4f54-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-873e4f54-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb8b5ba5-5fb4f495b6-4947s

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb8b5ba5-b497879c5-9gqk6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-f1c4045f-6f6bd678b8-smv6j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f1c4045f-7fb96bbf5-c95gj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-873e4f54-55948f5c59-wv89h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-873e4f54-84b4fdbd5d-wjtr9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-98f58556-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-98f58556-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-cc59b5af-c8cb45d5d-cpdjz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cc59b5af-75b6d87c8c-kjpjt

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-551dd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-551dd1
(x6)

openshift-ingress

kubelet

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

openshift-ingress

kubelet

e2e-ait-873e4f54-openshift-default-5bd9df9c57-rhhjf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-e652ca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-e652ca

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-7a8b03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-7a8b03

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-fb8b5ba5-gw-openshift-default-646b74cfb5-4rvwz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-f1c4045f-openshift-default-85f8967bbc-sgvkj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-cc59b5af-openshift-default-6fcc8f67b5-8js2t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-bb86fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-bb86fd

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-551dd1: serviceaccount "payload-processing-e2e-worker-w3-551dd1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55-swrq2

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55-swrq2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55-swrq2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55-swrq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55-swrq2

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-551dd1: serviceaccount "payload-processing-e2e-worker-w3-551dd1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-551dd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-551dd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44-2jnp5

openshift-ingress

multus

payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44-2jnp5

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44-2jnp5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44-2jnp5

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-e652ca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-e652ca-7f8745bddb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44-2jnp5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-98f58556-75bd57c5c5-mnztm

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-e652ca-7f8745bddb-kcxfc

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-h9q7m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-h9q7m

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-h9q7m

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-98f58556-f9d6f6b84-pkxqr

Killing

Stopping container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e652ca-7f8745bddb

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-e652ca-7f8745bddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e652ca: serviceaccount "payload-processing-e2e-worker-w4-e652ca" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-h9q7m

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e652ca-7f8745bddb

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-e652ca-7f8745bddb-kcxfc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-e652ca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e652ca: serviceaccount "payload-processing-e2e-worker-w4-e652ca" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-h9q7m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e652ca-7f8745bddb-kcxfc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e652ca-7f8745bddb-kcxfc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e652ca-7f8745bddb-kcxfc

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-7a8b03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-7a8b03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-7a8b03-84f9f89544 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7a8b03-84f9f89544

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-7a8b03-84f9f89544-dsz5l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7a8b03-84f9f89544

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-7a8b03-84f9f89544-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7a8b03: serviceaccount "payload-processing-e2e-worker-w0-7a8b03" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7a8b03: serviceaccount "payload-processing-e2e-worker-w0-7a8b03" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595-6krft

openshift-ingress

multus

payload-processing-e2e-worker-w0-7a8b03-84f9f89544-dsz5l

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-bb86fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-bb86fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-4kzgq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-bb86fd: serviceaccount "payload-processing-e2e-worker-w2-bb86fd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595-6krft

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595-6krft

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595-6krft

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7a8b03-84f9f89544-dsz5l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7a8b03-84f9f89544-dsz5l

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595-6krft

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7a8b03-84f9f89544-dsz5l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-bb86fd: serviceaccount "payload-processing-e2e-worker-w2-bb86fd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-vd9hg

openshift-ingress

multus

payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-vd9hg

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-vd9hg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-4kzgq

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-4kzgq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-vd9hg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-vd9hg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-4kzgq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-4kzgq

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-6ff0e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-6ff0e6

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-98f58556-openshift-default-578678f5b9-9q7pd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": read tcp 10.133.0.2:46414->10.133.0.41:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": read tcp 10.133.0.2:46414->10.133.0.41:15021: read: connection reset by peer body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-6ff0e6: serviceaccount "payload-processing-e2e-worker-w1-6ff0e6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-6ff0e6: serviceaccount "payload-processing-e2e-worker-w1-6ff0e6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-x5455

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-6ff0e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-6ff0e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-bb529

openshift-ingress

multus

payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-bb529

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-bb529

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-x5455

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-x5455

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-x5455

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-x5455

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-bb529

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-bb529

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 1 to 2

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-d654b97b9 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-d654b97b9-6dss4

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-d654b97b9-6dss4

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-d654b97b9-6dss4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-d654b97b9-6dss4

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-d654b97b9

FailedCreate

Error creating: pods "payload-processing-external-model-d654b97b9-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-d654b97b9

SuccessfulCreate

Created pod: payload-processing-external-model-d654b97b9-6dss4

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d

Started

Container started

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-c56dbf545 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-c56dbf545

SuccessfulCreate

Created pod: payload-processing-external-model-c56dbf545-9hp6z

models-as-a-service

multus

payload-processing-external-model-c56dbf545-9hp6z

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-c56dbf545-9hp6z

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-c56dbf545-9hp6z

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-c56dbf545-9hp6z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-cdc946f8b-psdq4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-cdc946f8b-psdq4

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-c56dbf545

SuccessfulDelete

Deleted pod: payload-processing-external-model-c56dbf545-9hp6z

models-as-a-service

replicaset-controller

payload-processing-external-model-cdc946f8b

SuccessfulCreate

Created pod: payload-processing-external-model-cdc946f8b-psdq4

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-c56dbf545 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-cdc946f8b-psdq4

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-c56dbf545-9hp6z

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-cdc946f8b-psdq4

Started

Container started
(x4)

models-as-a-service

kubelet

payload-processing-external-model-c56dbf545-9hp6z

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-69b689882f95" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-d654b97b9 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-d654b97b9-6dss4

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-d654b97b9

SuccessfulDelete

Deleted pod: payload-processing-external-model-d654b97b9-6dss4

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-947b6b675 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-947b6b675

SuccessfulCreate

Created pod: payload-processing-external-model-947b6b675-9k2tf

models-as-a-service

kubelet

payload-processing-external-model-947b6b675-9k2tf

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-947b6b675-9k2tf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-947b6b675-9k2tf

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-947b6b675-9k2tf

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-cdc946f8b from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-cdc946f8b-psdq4

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-cdc946f8b

SuccessfulDelete

Deleted pod: payload-processing-external-model-cdc946f8b-psdq4

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 2 to 4

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

Started

Container started

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 3 to 5

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

Started

Container started
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-cdc946f8b from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-cdc946f8b

SuccessfulCreate

Created pod: payload-processing-external-model-cdc946f8b-kw469

models-as-a-service

multus

payload-processing-external-model-cdc946f8b-kw469

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-cdc946f8b-kw469

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-cdc946f8b-kw469

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-cdc946f8b-kw469

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-947b6b675-9k2tf

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-cdc946f8b-kw469

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-947b6b675 from 1 to 0

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-947b6b675

SuccessfulDelete

Deleted pod: payload-processing-external-model-947b6b675-9k2tf

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 2 to 3
(x7)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qvm42

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

Unhealthy

Readiness probe failed: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qvm42

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

ProbeError

Readiness probe error: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

Unhealthy

Readiness probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

Unhealthy

Readiness probe failed: Get "http://10.133.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

ProbeError

Readiness probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

ProbeError

Readiness probe error: Get "http://10.133.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 5 to 6

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 3 to 5

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulCreate

Created pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 6 to 10

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 4 to 8

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

Started

Container started

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

Created

Container created

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-549nm

Unhealthy

Readiness probe failed: Get "http://10.133.0.20:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 5 to 6
(x3)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs
(x11)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-549nm

Unhealthy

Liveness probe failed: Get "http://10.133.0.20:6080/livez": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 6 to 8

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

Created

Container created

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

Started

Container started

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

Unhealthy

Liveness probe failed: Get "https://10.134.0.44:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 5 to 7

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-a-87cae1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-87cae1

openshift-ingress

deployment-controller

e2e-api-a-87cae1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-87cae1-openshift-default-55bbb4f6cf from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-87cae1-openshift-default-55bbb4f6cf

SuccessfulCreate

Created pod: e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6

openshift-ingress

multus

e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-87cae1-75d9855d76

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-87cae1-75d9855d76-mgtst
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-87cae1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-87cae1-f4ff486c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-87cae1-f4ff486c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-87cae1-f4ff486c5-npnrr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-87cae1-f4ff486c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-87cae1-f4ff486c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-87cae1: serviceaccount "payload-processing-e2e-api-a-87cae1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-87cae1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-87cae1-75d9855d76 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-87cae1-75d9855d76

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-87cae1-75d9855d76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-87cae1: serviceaccount "payload-processing-e2e-api-a-87cae1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87cae1-f4ff486c5-npnrr

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

Unhealthy

Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-87cae1-75d9855d76-mgtst

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87cae1-f4ff486c5-npnrr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87cae1-f4ff486c5-npnrr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-87cae1-f4ff486c5-npnrr

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

ProbeError

Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-87cae1-75d9855d76-mgtst

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-87cae1-75d9855d76-mgtst

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-87cae1-75d9855d76-mgtst

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-mt-ea117f29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ea117f29

openshift-ingress

deployment-controller

e2e-mt-ea117f29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ea117f29-openshift-default-7c448945 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-ea117f29-openshift-default-7c448945

SuccessfulCreate

Created pod: e2e-mt-ea117f29-openshift-default-7c448945-djmq5

openshift-ingress

multus

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ea117f29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ea117f29-67d879c59b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ea117f29-67d879c59b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ea117f29-67d879c59b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ea117f29: serviceaccount "payload-processing-e2e-mt-ea117f29" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ea117f29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ea117f29-85c756767f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ea117f29-67d879c59b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ea117f29-67d879c59b-xspsv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ea117f29-85c756767f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ea117f29-85c756767f-tzp9z
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ea117f29-85c756767f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ea117f29-85c756767f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ea117f29: serviceaccount "payload-processing-e2e-mt-ea117f29" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-ea117f29-85c756767f-tzp9z

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ea117f29-67d879c59b-xspsv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mnrt8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-mt-ea117f29-67d879c59b-xspsv

Started

Container started

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-mnrt8

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ea117f29-85c756767f-tzp9z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ea117f29-85c756767f-tzp9z

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-mnrt8

openshift-ingress

kubelet

payload-processing-e2e-mt-ea117f29-67d879c59b-xspsv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-ea117f29-67d879c59b-xspsv

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ea117f29-85c756767f-tzp9z

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mnrt8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.653s (3.653s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mnrt8

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mnrt8

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mnrt8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mnrt8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-2e0e28

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2e0e28

openshift-ingress

deployment-controller

e2e-api-a-2e0e28-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2e0e28-openshift-default-cf88cc7c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-2e0e28-openshift-default-cf88cc7c7

SuccessfulCreate

Created pod: e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

openshift-ingress

multus

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-f399fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f399fe

openshift-ingress

replicaset-controller

e2e-api-b-f399fe-openshift-default-645b7fcddc

SuccessfulCreate

Created pod: e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

openshift-ingress

deployment-controller

e2e-api-b-f399fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f399fe-openshift-default-645b7fcddc from 0 to 1

openshift-ingress

multus

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2e0e28

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2e0e28-865bb67d4b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2e0e28

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2e0e28: serviceaccount "payload-processing-e2e-api-a-2e0e28" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-2e0e28-865bb67d4b-fvl9b

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2e0e28-865bb67d4b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2e0e28-865bb67d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2e0e28: serviceaccount "payload-processing-e2e-api-a-2e0e28" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79-5h4j5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-2e0e28-865bb67d4b-fvl9b

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79-5h4j5

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-2e0e28-865bb67d4b-fvl9b

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79-5h4j5

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2e0e28-865bb67d4b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2e0e28-865bb67d4b-fvl9b

openshift-ingress

kubelet

payload-processing-e2e-api-a-2e0e28-865bb67d4b-fvl9b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79-5h4j5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79-5h4j5

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ea117f29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ea117f29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f399fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c-2fgcz

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f399fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f399fe-966c95876 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f399fe: serviceaccount "payload-processing-e2e-api-b-f399fe" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f399fe-966c95876

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f399fe-966c95876-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f399fe: serviceaccount "payload-processing-e2e-api-b-f399fe" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c-2fgcz

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f399fe-966c95876

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f399fe-966c95876-z6jf4

openshift-ingress

kubelet

payload-processing-e2e-api-b-f399fe-966c95876-z6jf4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c-2fgcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c-2fgcz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-f399fe-966c95876-z6jf4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-f399fe-966c95876-z6jf4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c-2fgcz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-f399fe-966c95876-z6jf4

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-87cae1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-87cae1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2e0e28-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2e0e28-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-4561d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4561d2

openshift-ingress

replicaset-controller

e2e-api-b-4561d2-openshift-default-854f7c5995

SuccessfulCreate

Created pod: e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

openshift-ingress

deployment-controller

e2e-api-b-4561d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4561d2-openshift-default-854f7c5995 from 0 to 1

openshift-ingress

multus

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4561d2-6dc4f865fb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4561d2-6dc4f865fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4561d2: serviceaccount "payload-processing-e2e-api-b-4561d2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4561d2-6dc4f865fb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4561d2-6dc4f865fb-rmvnd

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4561d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4561d2-6dc4f865fb from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4561d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4561d2-56796f756c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4561d2-56796f756c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4561d2-56796f756c-xgkvk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4561d2-56796f756c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4561d2-56796f756c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4561d2: serviceaccount "payload-processing-e2e-api-b-4561d2" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4561d2-56796f756c-xgkvk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4561d2-56796f756c-xgkvk

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4561d2-56796f756c-xgkvk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4561d2-56796f756c-xgkvk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-4561d2-6dc4f865fb-rmvnd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-4561d2-6dc4f865fb-rmvnd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-4561d2-6dc4f865fb-rmvnd

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-4561d2-6dc4f865fb-rmvnd

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f399fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f399fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87cae1-f4ff486c5-npnrr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-87cae1-75d9855d76-mgtst

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f399fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f399fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4561d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4561d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-87cae1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-87cae1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ea117f29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ea117f29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

Unhealthy

Readiness probe failed: Get "http://10.132.0.126:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

ProbeError

Readiness probe error: Get "http://10.132.0.126:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2e0e28-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2e0e28-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

Created

Container created

opendatahub

multus

test-curl-11526-de39c3

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-2e0e28-865bb67d4b-fvl9b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2e0e28-6c88d56c79-5h4j5

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-11526-de39c3

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

kubelet

e2e-api-a-87cae1-openshift-default-55bbb4f6cf-j9kc6

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

Unhealthy

Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

ProbeError

Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-11526-de39c3

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 4.724s (4.724s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11526-de39c3

Created

Container created

opendatahub

kubelet

test-curl-11526-de39c3

Started

Container started

opendatahub

kubelet

test-curl-11526-de39c3

Killing

Stopping container test-curl-11526-de39c3

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f399fe-6c5d9f9d8c-2fgcz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f399fe-966c95876-z6jf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ea117f29-85c756767f-tzp9z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ea117f29-67d879c59b-xspsv

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-api-a-f60f16-openshift-default-cf58d98f9

SuccessfulCreate

Created pod: e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd

openshift-ingress

deployment-controller

e2e-api-a-f60f16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f60f16-openshift-default-cf58d98f9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-f60f16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f60f16

openshift-ingress

multus

e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f60f16-57546d5647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f60f16-57546d5647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f60f16: serviceaccount "payload-processing-e2e-api-a-f60f16" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f60f16-6d7888d9c6

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f60f16-6d7888d9c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f60f16: serviceaccount "payload-processing-e2e-api-a-f60f16" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f60f16-57546d5647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f60f16-57546d5647-z6kxr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f60f16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f60f16-57546d5647 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f60f16-6d7888d9c6

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f60f16-6d7888d9c6-smv2t

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f60f16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f60f16-6d7888d9c6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f60f16-57546d5647-z6kxr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f60f16-57546d5647-z6kxr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f60f16-6d7888d9c6-smv2t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f60f16-6d7888d9c6-smv2t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-f60f16-6d7888d9c6-smv2t

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-f60f16-6d7888d9c6-smv2t

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f60f16-57546d5647-z6kxr

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f60f16-57546d5647-z6kxr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-2e0e28-openshift-default-cf88cc7c7-mjsl5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ea117f29-85c756767f-tzp9z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-ea117f29-67d879c59b-xspsv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4561d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4561d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4561d2-56796f756c-xgkvk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4561d2-6dc4f865fb-rmvnd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ea117f29-85c756767f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ea117f29-85c756767f-lwk4k

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ea117f29-67d879c59b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ea117f29-67d879c59b-wrh5r

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ea117f29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ea117f29-67d879c59b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ea117f29-67d879c59b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ea117f29-67d879c59b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ea117f29: serviceaccount "payload-processing-e2e-mt-ea117f29" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ea117f29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ea117f29-85c756767f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ea117f29-85c756767f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ea117f29-85c756767f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ea117f29: serviceaccount "payload-processing-e2e-mt-ea117f29" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ea117f29-85c756767f-lwk4k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ea117f29-85c756767f-lwk4k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-ea117f29-67d879c59b-wrh5r

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-ea117f29-85c756767f-lwk4k

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ea117f29-67d879c59b-wrh5r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ea117f29-85c756767f-lwk4k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-ea117f29-67d879c59b-wrh5r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-ea117f29-67d879c59b-wrh5r

Started

Container started

openshift-ingress

kubelet

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-f399fe-openshift-default-645b7fcddc-k8zw4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f60f16-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f60f16-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd

Created

Container created

openshift-ingress

deployment-controller

e2e-api-b-a2768f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a2768f-openshift-default-7f8c86cc95 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-a2768f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a2768f

openshift-ingress

replicaset-controller

e2e-api-b-a2768f-openshift-default-7f8c86cc95

SuccessfulCreate

Created pod: e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh

openshift-ingress

multus

e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a2768f-5b7fc6c6d8

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a2768f-5b7fc6c6d8-cqfzn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a2768f-5b7fc6c6d8

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a2768f-5b7fc6c6d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a2768f: serviceaccount "payload-processing-e2e-api-b-a2768f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a2768f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a2768f-5b7fc6c6d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9-g7tf9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a2768f: serviceaccount "payload-processing-e2e-api-b-a2768f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a2768f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-a2768f-5b7fc6c6d8-cqfzn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9-g7tf9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-a2768f-5b7fc6c6d8-cqfzn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-a2768f-5b7fc6c6d8-cqfzn

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9-g7tf9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-a2768f-5b7fc6c6d8-cqfzn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9-g7tf9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9-g7tf9

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

opendatahub

multus

test-curl-11526-85778e

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11526-85778e

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-11526-85778e

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.35s (2.35s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11526-85778e

Started

Container started

opendatahub

kubelet

test-curl-11526-85778e

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-9368ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9368ce-openshift-default-54455b6995 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9368ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9368ce

openshift-ingress

replicaset-controller

e2e-ipp-a-9368ce-openshift-default-54455b6995

SuccessfulCreate

Created pod: e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

openshift-ingress

multus

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11526-85778e

Killing

Stopping container test-curl-11526-85778e

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9368ce-79658d9d7b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9368ce-79658d9d7b-76tml

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9368ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9368ce-79658d9d7b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9368ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9368ce-79658d9d7b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9368ce-79658d9d7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9368ce: serviceaccount "payload-processing-e2e-ipp-a-9368ce" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579-znb9d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9368ce: serviceaccount "payload-processing-e2e-ipp-a-9368ce" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579-znb9d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9368ce-79658d9d7b-76tml

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9368ce-79658d9d7b-76tml

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579-znb9d

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-9368ce-79658d9d7b-76tml

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579-znb9d

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579-znb9d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9368ce-79658d9d7b-76tml

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f60f16-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f60f16-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ea117f29-85c756767f-lwk4k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ea117f29-67d879c59b-wrh5r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-4561d2-openshift-default-854f7c5995-87tt2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6f0f50

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6f0f50

openshift-ingress

replicaset-controller

e2e-ipp-a-6f0f50-openshift-default-688859fb8f

SuccessfulCreate

Created pod: e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

openshift-ingress

deployment-controller

e2e-ipp-a-6f0f50-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6f0f50-openshift-default-688859fb8f from 0 to 1

openshift-ingress

multus

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6f0f50: serviceaccount "payload-processing-e2e-ipp-a-6f0f50" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67-dnjmt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6f0f50-58d7c5b446

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6f0f50-58d7c5b446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6f0f50: serviceaccount "payload-processing-e2e-ipp-a-6f0f50" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6f0f50-58d7c5b446

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6f0f50-58d7c5b446-6cwjn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6f0f50

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6f0f50-58d7c5b446 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6f0f50

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-6f0f50-58d7c5b446-6cwjn

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67-dnjmt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67-dnjmt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67-dnjmt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6f0f50-58d7c5b446-6cwjn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6f0f50-58d7c5b446-6cwjn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6f0f50-58d7c5b446-6cwjn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67-dnjmt

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9368ce-5f45c9f579-znb9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9368ce-79658d9d7b-76tml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f60f16-57546d5647-z6kxr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f60f16-6d7888d9c6-smv2t

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9368ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9368ce-6bc4c59674

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9368ce-6bc4c59674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9368ce: serviceaccount "payload-processing-e2e-ipp-a-9368ce" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9368ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9368ce-6bc4c59674 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9368ce: serviceaccount "payload-processing-e2e-ipp-a-9368ce" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-zsxww

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-9368ce-6bc4c59674-vhsbt

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9368ce-6bc4c59674

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9368ce-6bc4c59674-vhsbt

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-zsxww

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-zsxww

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9368ce-6bc4c59674-vhsbt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9368ce-6bc4c59674-vhsbt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-zsxww

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.027s (2.027s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-zsxww

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9368ce-6bc4c59674-vhsbt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.83s (1.83s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6f0f50-6cfbb89f67-dnjmt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6f0f50-58d7c5b446-6cwjn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-zsxww

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9368ce-6bc4c59674-vhsbt

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

Unhealthy

Readiness probe failed: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

ProbeError

Readiness probe error: Get "http://10.134.0.105:15021/healthz/ready": read tcp 10.134.0.2:44134->10.134.0.105:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

Unhealthy

Readiness probe failed: Get "http://10.134.0.105:15021/healthz/ready": read tcp 10.134.0.2:44134->10.134.0.105:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

ProbeError

Readiness probe error: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6f0f50

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6f0f50-668d688948 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6f0f50-668d688948

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6f0f50-668d688948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6f0f50: serviceaccount "payload-processing-e2e-ipp-a-6f0f50" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6f0f50: serviceaccount "payload-processing-e2e-ipp-a-6f0f50" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5-rmt4n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6f0f50

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6f0f50-668d688948-srbpl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5-rmt4n

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-6f0f50-668d688948-srbpl

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6f0f50-668d688948

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6f0f50-668d688948-srbpl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5-rmt4n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5-rmt4n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5-rmt4n

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6f0f50-668d688948-srbpl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6f0f50-668d688948-srbpl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-f60f16-openshift-default-cf58d98f9-6gnzd

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-405eb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-405eb1-openshift-default-7778848687 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-405eb1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-405eb1

openshift-ingress

replicaset-controller

e2e-ipp-b-405eb1-openshift-default-7778848687

SuccessfulCreate

Created pod: e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7

openshift-ingress

multus

e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-a-3a236d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-3a236d

openshift-ingress

deployment-controller

e2e-api-a-3a236d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-3a236d-openshift-default-75957d8c95 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-3a236d-openshift-default-75957d8c95

SuccessfulCreate

Created pod: e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6f0f50-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6f0f50-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9368ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9368ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-ea117f29-openshift-default-7c448945-djmq5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-405eb1: serviceaccount "payload-processing-e2e-ipp-b-405eb1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-405eb1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-405eb1-78879888cb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-405eb1-78879888cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-405eb1-78879888cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-405eb1: serviceaccount "payload-processing-e2e-ipp-b-405eb1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-405eb1-78879888cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-405eb1-78879888cb-zrrpk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-405eb1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9-dgnkh

openshift-ingress

multus

payload-processing-e2e-ipp-b-405eb1-78879888cb-zrrpk

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9-dgnkh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9-dgnkh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9-dgnkh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9-dgnkh

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-405eb1-78879888cb-zrrpk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-405eb1-78879888cb-zrrpk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-405eb1-78879888cb-zrrpk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3a236d: serviceaccount "payload-processing-e2e-api-a-3a236d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc-2smdn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3a236d-85d875b7fb

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-3a236d-85d875b7fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3a236d: serviceaccount "payload-processing-e2e-api-a-3a236d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-3a236d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-3a236d-85d875b7fb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3a236d-85d875b7fb

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-3a236d-85d875b7fb-sbg88

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-3a236d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a236d-85d875b7fb-sbg88

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-a2768f-5b7fc6c6d8-cqfzn

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a1ee32

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a1ee32

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc-2smdn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc-2smdn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc-2smdn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc-2smdn

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a236d-85d875b7fb-sbg88

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a2768f-6b7479d5c9-g7tf9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a236d-85d875b7fb-sbg88

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-b-a1ee32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f

SuccessfulCreate

Created pod: e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

openshift-ingress

multus

payload-processing-e2e-api-a-3a236d-85d875b7fb-sbg88

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1ee32: serviceaccount "payload-processing-e2e-ipp-b-a1ee32" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1ee32-fd7766b56

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a1ee32-fd7766b56-fh9xt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a1ee32

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a1ee32

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a1ee32-fd7766b56 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1ee32-fd7766b56

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a1ee32-fd7766b56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1ee32: serviceaccount "payload-processing-e2e-ipp-b-a1ee32" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59-xjbhm

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1ee32-fd7766b56-fh9xt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59-xjbhm

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59-xjbhm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1ee32-fd7766b56-fh9xt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-a1ee32-fd7766b56-fh9xt

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59-xjbhm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1ee32-fd7766b56-fh9xt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59-xjbhm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9368ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9368ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a2768f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a2768f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-cv4lr
(x6)

openshift-ingress

kubelet

e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 10 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rf7z6
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6f0f50-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6f0f50-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a2768f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a2768f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-cclzd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 9 to 6

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-slpm9

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-rkp5z
(x2)

openshift-ingress

kubelet

e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-405eb1-78879888cb-zrrpk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-405eb1-86db5f6bc9-dgnkh

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3a236d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3a236d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-api-b-a121dd-openshift-default-64755bb657

SuccessfulCreate

Created pod: e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v

openshift-ingress

gateway_labeler_controller

e2e-api-b-a121dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a121dd

openshift-ingress

deployment-controller

e2e-api-b-a121dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a121dd-openshift-default-64755bb657 from 0 to 1

openshift-ingress

multus

e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-a2768f-openshift-default-7f8c86cc95-bjzlh

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp

Unhealthy

Startup probe failed: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp

ProbeError

Startup probe error: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-fa855c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-fa855c

openshift-ingress

multus

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-fa855c-openshift-default-675f746795

SuccessfulCreate

Created pod: e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

openshift-ingress

deployment-controller

e2e-ipp-a-fa855c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-fa855c-openshift-default-675f746795 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulDelete

Deleted pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a121dd-5497f8dc87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a121dd-5497f8dc87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a121dd: serviceaccount "payload-processing-e2e-api-b-a121dd" not found

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulDelete

Deleted pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulDelete

Deleted pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a121dd-646987b794

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a121dd-646987b794-9bfdk

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sslhz

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-sgkrd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a121dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a121dd-5497f8dc87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a121dd-5497f8dc87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a121dd-5497f8dc87-n2zbm

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 10 to 6

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a121dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a121dd-646987b794 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulDelete

Deleted pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-6gx5d
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a121dd-646987b794

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a121dd-646987b794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a121dd: serviceaccount "payload-processing-e2e-api-b-a121dd" not found

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-kfhm4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a121dd-5497f8dc87-n2zbm

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-a121dd-646987b794-9bfdk

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a121dd-646987b794-9bfdk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-a121dd-646987b794-9bfdk

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-f9c553-openshift-default-77f8888997

SuccessfulCreate

Created pod: e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

openshift-ingress

deployment-controller

e2e-ipp-a-f9c553-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f9c553-openshift-default-77f8888997 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-a121dd-646987b794-9bfdk

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f9c553

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f9c553

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a121dd-5497f8dc87-n2zbm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a121dd-5497f8dc87-n2zbm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a121dd-5497f8dc87-n2zbm

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fa855c-68d9597b9b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-fa855c-68d9597b9b-n5cvn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c-gqsp8

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-fa855c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-fa855c-68d9597b9b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fa855c-68d9597b9b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-fa855c-68d9597b9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fa855c: serviceaccount "payload-processing-e2e-ipp-a-fa855c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-fa855c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fa855c: serviceaccount "payload-processing-e2e-ipp-a-fa855c" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c-gqsp8

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c-gqsp8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-fa855c-68d9597b9b-n5cvn

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fa855c-68d9597b9b-n5cvn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1ee32-774dc7db59-xjbhm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1ee32-fd7766b56-fh9xt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c-gqsp8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c-gqsp8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fa855c-68d9597b9b-n5cvn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fa855c-68d9597b9b-n5cvn

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f9c553: serviceaccount "payload-processing-e2e-ipp-a-f9c553" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f9c553: serviceaccount "payload-processing-e2e-ipp-a-f9c553" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f9c553

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f9c553

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795-lhvr7
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-405eb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-405eb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6-5mw9n

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795-lhvr7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795-lhvr7

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3a236d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795-lhvr7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3a236d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795-lhvr7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6-5mw9n

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6-5mw9n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6-5mw9n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6-5mw9n

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-405eb1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-405eb1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-405eb1-7869d65754 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-405eb1: serviceaccount "payload-processing-e2e-ipp-b-405eb1" not found
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-405eb1-7869d65754

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-405eb1-7869d65754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-405eb1: serviceaccount "payload-processing-e2e-ipp-b-405eb1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-76r22

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-405eb1-7869d65754

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-405eb1-7869d65754-z8bgm

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-76r22

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-76r22

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-405eb1-7869d65754-z8bgm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-b-405eb1-7869d65754-z8bgm

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-405eb1-7869d65754-z8bgm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-76r22

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-405eb1-7869d65754-z8bgm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.253s (1.253s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-405eb1-7869d65754-z8bgm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-76r22

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-76r22

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.658s (1.658s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

ProbeError

Readiness probe error: Get "http://10.133.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

Unhealthy

Readiness probe failed: Get "http://10.133.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-405eb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-405eb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a1ee32

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1ee32: serviceaccount "payload-processing-e2e-ipp-b-a1ee32" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a1ee32

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a1ee32-59995768db from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1ee32-59995768db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a1ee32-59995768db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1ee32: serviceaccount "payload-processing-e2e-ipp-b-a1ee32" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7-xdfwc

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1ee32-59995768db-lhgvn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1ee32-59995768db-lhgvn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1ee32-59995768db-lhgvn

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1ee32-59995768db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a1ee32-59995768db-lhgvn

openshift-ingress

multus

payload-processing-e2e-ipp-b-a1ee32-59995768db-lhgvn

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7-xdfwc

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7-xdfwc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7-xdfwc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7-xdfwc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulDelete

Deleted pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-flwwn

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulDelete

Deleted pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulDelete

Deleted pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-dv87s

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulDelete

Deleted pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-9j9hp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-26sgv

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

ProbeError

Readiness probe error: Get "http://10.132.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a1ee32-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a1ee32-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

Unhealthy

Readiness probe failed: Get "http://10.132.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9368ce-ddbf89db7-zsxww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9368ce-6bc4c59674-vhsbt

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ndhdh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-ds7v7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-8s97x

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-9c98t
(x5)

openshift-ingress

kubelet

e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a121dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a121dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-9368ce-openshift-default-54455b6995-6nc2b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fa855c-68d9597b9b-n5cvn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fa855c-5d5885476c-gqsp8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f9c553-747bdf6795-lhvr7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f9c553-5fbb7c76b6-5mw9n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a236d-85d875b7fb-sbg88

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a236d-75ff5cb6bc-2smdn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6f0f50-698cd75fc5-rmt4n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6f0f50-668d688948-srbpl

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a121dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a121dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-fa855c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-fa855c-694549449d from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-fa855c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-fa855c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fa855c-694549449d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-fa855c-694549449d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fa855c: serviceaccount "payload-processing-e2e-ipp-a-fa855c" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fa855c: serviceaccount "payload-processing-e2e-ipp-a-fa855c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7-4tnbs

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fa855c-694549449d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-fa855c-694549449d-psnv9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-fa855c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-fa855c-694549449d-psnv9

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7-4tnbs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7-4tnbs

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fa855c-694549449d-psnv9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fa855c-694549449d-psnv9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7-4tnbs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7-4tnbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fa855c-694549449d-psnv9

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-6f0f50-openshift-default-688859fb8f-k4w4t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f9c553

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f9c553-959488f9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f9c553

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f9c553-7b94f54fb from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f9c553-7b94f54fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f9c553-7b94f54fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f9c553: serviceaccount "payload-processing-e2e-ipp-a-f9c553" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f9c553-959488f9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f9c553-959488f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f9c553: serviceaccount "payload-processing-e2e-ipp-a-f9c553" not found

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

ProbeError

Readiness probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

Unhealthy

Readiness probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f9c553-7b94f54fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f9c553-7b94f54fb-fvwz2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f9c553-959488f9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f9c553-959488f9f-nvj4k

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f9c553-959488f9f-nvj4k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f9c553-959488f9f-nvj4k

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f9c553-7b94f54fb-fvwz2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f9c553-7b94f54fb-fvwz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f9c553-7b94f54fb-fvwz2

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f9c553-959488f9f-nvj4k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f9c553-959488f9f-nvj4k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f9c553-7b94f54fb-fvwz2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-405eb1-c5d464c8c-76r22

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-405eb1-7869d65754-z8bgm

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1ee32-84d5d647d7-xdfwc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1ee32-59995768db-lhgvn

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-6e0e74-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6e0e74-openshift-default-74dbf5d47 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47

SuccessfulCreate

Created pod: e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6e0e74

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6e0e74

openshift-ingress

multus

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f9c553-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f9c553-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-405eb1-openshift-default-7778848687-nd8k7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-76c107

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-76c107

openshift-ingress

deployment-controller

e2e-ipp-b-76c107-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-76c107-openshift-default-69f98c49 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-76c107-openshift-default-69f98c49

SuccessfulCreate

Created pod: e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

openshift-ingress

multus

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5

SuccessfulCreate

Created pod: e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-4a97e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-4a97e9

openshift-ingress

deployment-controller

e2e-praxis-a-4a97e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-3a236d-openshift-default-75957d8c95-f6czp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6e0e74

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6e0e74-56845b68bd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7-28vdh

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6e0e74-56845b68bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6e0e74-56845b68bd-cgg45
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6e0e74: serviceaccount "payload-processing-e2e-ipp-b-6e0e74" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7-28vdh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6e0e74

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6e0e74-56845b68bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6e0e74-56845b68bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6e0e74: serviceaccount "payload-processing-e2e-ipp-b-6e0e74" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-6e0e74-56845b68bd-cgg45

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7-28vdh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7-28vdh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6e0e74-56845b68bd-cgg45

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6e0e74-56845b68bd-cgg45

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7-28vdh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6e0e74-56845b68bd-cgg45

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-76c107

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-76c107-7c5ccc8494 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-76c107-7c5ccc8494

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-76c107-7c5ccc8494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-76c107: serviceaccount "payload-processing-e2e-ipp-b-76c107" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-76c107

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647-l8pjc

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-76c107-7c5ccc8494

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-76c107-7c5ccc8494-w9bl2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-76c107: serviceaccount "payload-processing-e2e-ipp-b-76c107" not found

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647-l8pjc

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c

SuccessfulCreate

Created pod: e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

openshift-ingress

deployment-controller

e2e-praxis-a-8c35df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-76c107-7c5ccc8494-w9bl2

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76c107-7c5ccc8494-w9bl2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76c107-7c5ccc8494-w9bl2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76c107-7c5ccc8494-w9bl2

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-8c35df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-8c35df

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647-l8pjc

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647-l8pjc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-a1ee32-openshift-default-85d4d9cf9f-2nhn7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647-l8pjc

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9-8wgdx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4a97e9-677745666b

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-4a97e9-677745666b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4a97e9: serviceaccount "payload-processing-e2e-praxis-a-4a97e9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-4a97e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-4a97e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-4a97e9-677745666b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4a97e9-677745666b

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-4a97e9-677745666b-rgc9c
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4a97e9: serviceaccount "payload-processing-e2e-praxis-a-4a97e9" not found

openshift-ingress

multus

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-4a97e9-677745666b-rgc9c

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4a97e9-677745666b-rgc9c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4a97e9-677745666b-rgc9c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4a97e9-677745666b-rgc9c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9-8wgdx

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9-8wgdx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9-8wgdx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9-8wgdx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8c35df-7944fdb8b6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-8c35df-7944fdb8b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8c35df: serviceaccount "payload-processing-e2e-praxis-a-8c35df" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8c35df: serviceaccount "payload-processing-e2e-praxis-a-8c35df" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-8c35df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-8c35df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-8c35df-7944fdb8b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8c35df-7944fdb8b6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-8c35df-7944fdb8b6-b8xzg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c-kddq6

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c-kddq6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a121dd-5497f8dc87-n2zbm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c-kddq6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-a121dd-646987b794-9bfdk

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c-kddq6

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8c35df-7944fdb8b6-b8xzg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8c35df-7944fdb8b6-b8xzg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c-kddq6

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f9c553-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f9c553-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8c35df-7944fdb8b6-b8xzg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-8c35df-7944fdb8b6-b8xzg

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6e0e74-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6e0e74-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6e0e74-698b445bb7-28vdh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6e0e74-56845b68bd-cgg45

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

Unhealthy

Readiness probe failed: Get "http://10.134.0.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76c107-57c4dbc647-l8pjc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

ProbeError

Readiness probe error: Get "http://10.134.0.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76c107-7c5ccc8494-w9bl2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

ProbeError

Readiness probe error: Get "http://10.134.0.129:15021/healthz/ready": read tcp 10.134.0.2:50078->10.134.0.129:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

Unhealthy

Readiness probe failed: Get "http://10.134.0.129:15021/healthz/ready": read tcp 10.134.0.2:50078->10.134.0.129:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

Unhealthy

Readiness probe failed: Get "http://10.134.0.128:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

ProbeError

Readiness probe error: Get "http://10.134.0.128:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-b-e954cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-e954cd-openshift-default-7557cd58fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-e954cd-openshift-default-7557cd58fc

SuccessfulCreate

Created pod: e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-e954cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-e954cd

openshift-ingress

multus

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

Unhealthy

Startup probe failed: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

ProbeError

Startup probe error: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e954cd: serviceaccount "payload-processing-e2e-praxis-b-e954cd" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-bpv9d

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-e954cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-e954cd-699b946766 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e954cd-699b946766

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-e954cd-699b946766-plqzh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e954cd-699b946766

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-e954cd-699b946766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e954cd: serviceaccount "payload-processing-e2e-praxis-b-e954cd" not found

openshift-ingress

replicaset-controller

e2e-praxis-b-aa466d-openshift-default-5798999957

SuccessfulCreate

Created pod: e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

openshift-ingress

deployment-controller

e2e-praxis-b-aa466d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-aa466d-openshift-default-5798999957 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-bpv9d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-e954cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-aa466d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-aa466d

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-bpv9d

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-e954cd-699b946766-plqzh

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-bpv9d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-bpv9d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e954cd-699b946766-plqzh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e954cd-699b946766-plqzh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e954cd-699b946766-plqzh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-76c107-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6e0e74

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-76c107-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7-4hvjk

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d-2fwdk
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4a97e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6e0e74: serviceaccount "payload-processing-e2e-ipp-b-6e0e74" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6e0e74: serviceaccount "payload-processing-e2e-ipp-b-6e0e74" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6e0e74

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4a97e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7-4hvjk

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d-2fwdk

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7-4hvjk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7-4hvjk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7-4hvjk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d-2fwdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d-2fwdk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d-2fwdk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-aa466d-7d69848679-w2mcg

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-aa466d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-aa466d-6d4d675cf8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-aa466d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-aa466d-7d69848679 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-aa466d-7d69848679-w2mcg

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-aa466d-6d4d675cf8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-aa466d-6d4d675cf8-6gplc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-aa466d-6d4d675cf8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-aa466d-6d4d675cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-aa466d: serviceaccount "payload-processing-e2e-praxis-b-aa466d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-aa466d-7d69848679-w2mcg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-aa466d-7d69848679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-aa466d-7d69848679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-aa466d: serviceaccount "payload-processing-e2e-praxis-b-aa466d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-aa466d-7d69848679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-aa466d-7d69848679-w2mcg

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-aa466d-6d4d675cf8-6gplc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-aa466d-6d4d675cf8-6gplc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-aa466d-7d69848679-w2mcg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-aa466d-6d4d675cf8-6gplc

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-aa466d-6d4d675cf8-6gplc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-76c107

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-76c107-59f7896687 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-76c107-59f7896687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-76c107-59f7896687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-76c107: serviceaccount "payload-processing-e2e-ipp-b-76c107" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-76c107

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-76c107-86c5c947d8 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-76c107-86c5c947d8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-76c107-86c5c947d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-76c107: serviceaccount "payload-processing-e2e-ipp-b-76c107" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-76c107-59f7896687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-76c107-59f7896687-s2tf2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76c107-59f7896687-s2tf2

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-76c107-86c5c947d8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-76c107-86c5c947d8-dh4hf

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-76c107-59f7896687-s2tf2

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76c107-59f7896687-s2tf2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76c107-59f7896687-s2tf2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-76c107-86c5c947d8-dh4hf

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76c107-86c5c947d8-dh4hf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76c107-86c5c947d8-dh4hf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76c107-86c5c947d8-dh4hf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-a121dd-openshift-default-64755bb657-tbb4v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

Unhealthy

Readiness probe failed: Get "http://10.133.0.111:15021/healthz/ready": read tcp 10.133.0.2:41702->10.133.0.111:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

ProbeError

Readiness probe error: Get "http://10.133.0.111:15021/healthz/ready": read tcp 10.133.0.2:41702->10.133.0.111:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc

SuccessfulCreate

Created pod: e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

openshift-ingress

deployment-controller

e2e-praxis-a-f9ea8f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f9ea8f-openshift-default-545548f9cc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-f9ea8f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-f9ea8f

openshift-ingress

multus

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-76c107-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-76c107-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4a97e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4a97e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9-8s6s9

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-f9ea8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-f9ea8f-86488b5698 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f9ea8f-86488b5698

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-f9ea8f-86488b5698-727l8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f9ea8f-86488b5698

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-f9ea8f-86488b5698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f9ea8f: serviceaccount "payload-processing-e2e-praxis-a-f9ea8f" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9-8s6s9

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f9ea8f: serviceaccount "payload-processing-e2e-praxis-a-f9ea8f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-f9ea8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f9ea8f-86488b5698-727l8

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-f9ea8f-86488b5698-727l8

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f9ea8f-86488b5698-727l8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9-8s6s9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9-8s6s9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9-8s6s9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f9ea8f-86488b5698-727l8

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6e0e74-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6e0e74-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8c35df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8c35df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fa855c-86757bcbb7-4tnbs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fa855c-694549449d-psnv9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e954cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e954cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-fa855c-openshift-default-675f746795-9hqn8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-aa466d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-aa466d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4a97e9-677745666b-rgc9c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4a97e9-7b4d9bd8c9-8wgdx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8c35df-7944fdb8b6-b8xzg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8c35df-57f5d4c84c-kddq6

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-d84f47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-d84f47

openshift-ingress

replicaset-controller

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5

SuccessfulCreate

Created pod: e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

openshift-ingress

deployment-controller

e2e-praxis-b-d84f47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

ProbeError

Readiness probe error: Get "http://10.134.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

Unhealthy

Readiness probe failed: Get "http://10.134.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6e0e74-749fd9cc5d-2fwdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6e0e74-696f4c45d7-4hvjk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-d84f47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-d84f47-68f6ff8b56 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-d84f47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47-8wdvj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d84f47-68f6ff8b56

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-d84f47-68f6ff8b56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d84f47: serviceaccount "payload-processing-e2e-praxis-b-d84f47" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d84f47-68f6ff8b56

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-d84f47-68f6ff8b56-hrf5l
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d84f47: serviceaccount "payload-processing-e2e-praxis-b-d84f47" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47-8wdvj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47-8wdvj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d84f47-68f6ff8b56-hrf5l

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47-8wdvj

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-d84f47-68f6ff8b56-hrf5l

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47-8wdvj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d84f47-68f6ff8b56-hrf5l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d84f47-68f6ff8b56-hrf5l

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e954cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-8c35df-openshift-default-6fb49dfb7c-z2tlm

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e954cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-6e0e74-openshift-default-74dbf5d47-rwqkn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-5ba2ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-5ba2ef
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-aa466d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-aa466d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-5ba2ef-openshift-default-555b66d977

SuccessfulCreate

Created pod: e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

openshift-ingress

deployment-controller

e2e-praxis-a-5ba2ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-5ba2ef-openshift-default-555b66d977 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f9ea8f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f9ea8f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-5ba2ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-5ba2ef: serviceaccount "payload-processing-e2e-praxis-a-5ba2ef" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-5ba2ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-5ba2ef-76df498cd6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-5ba2ef-76df498cd6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-5ba2ef-76df498cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-5ba2ef: serviceaccount "payload-processing-e2e-praxis-a-5ba2ef" not found

openshift-ingress

multus

payload-processing-e2e-praxis-a-5ba2ef-76df498cd6-lg7zt

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf-2c9fb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf-2c9fb

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-5ba2ef-76df498cd6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-5ba2ef-76df498cd6-lg7zt

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf-2c9fb

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-aa466d-7d69848679-w2mcg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5ba2ef-76df498cd6-lg7zt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-aa466d-6d4d675cf8-6gplc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5ba2ef-76df498cd6-lg7zt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf-2c9fb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5ba2ef-76df498cd6-lg7zt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf-2c9fb

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-4a97e9-openshift-default-b9f55f6d5-86znb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f9ea8f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f9ea8f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-bpv9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e954cd-699b946766-plqzh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 6 to 5

openshift-ingress

kubelet

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-aa466d-openshift-default-5798999957-7gtpc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulDelete

Deleted pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-tchxt
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5ba2ef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5ba2ef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e954cd-7fddbb56f9-bpv9d

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.117:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e954cd-699b946766-plqzh

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.118:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-e954cd-openshift-default-7557cd58fc-dqhvh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

Unhealthy

Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

ProbeError

Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d84f47-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d84f47-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ffbba3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ffbba3

openshift-ingress

replicaset-controller

e2e-praxis-b-ffbba3-openshift-default-6978cc47b5

SuccessfulCreate

Created pod: e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng

openshift-ingress

deployment-controller

e2e-praxis-b-ffbba3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ffbba3-openshift-default-6978cc47b5 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f9ea8f-664d6dddc9-8s6s9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f9ea8f-86488b5698-727l8

Killing

Stopping container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ffbba3-79b8659d9d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ffbba3-79b8659d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ffbba3: serviceaccount "payload-processing-e2e-praxis-b-ffbba3" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ffbba3: serviceaccount "payload-processing-e2e-praxis-b-ffbba3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5-rhb58

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ffbba3-79b8659d9d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ffbba3-79b8659d9d-wjmvq

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ffbba3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ffbba3-79b8659d9d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ffbba3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ffbba3-79b8659d9d-wjmvq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-ffbba3-79b8659d9d-wjmvq

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ffbba3-79b8659d9d-wjmvq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ffbba3-79b8659d9d-wjmvq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5-rhb58

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5-rhb58

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5-rhb58

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5-rhb58

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-f9c553-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f9c553-openshift-default-77f8888997 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f9c553-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-f9c553-openshift-default-77f8888997

SuccessfulCreate

Created pod: e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

ProbeError

Readiness probe error: Get "http://10.134.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

Unhealthy

Readiness probe failed: Get "http://10.134.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf

Unhealthy

Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf

ProbeError

Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

Started

Container started

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

Created

Container created

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f9c553-959488f9f-nvj4k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f9c553-7b94f54fb-fvwz2

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d84f47-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d84f47-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-praxis-a-f9ea8f-openshift-default-545548f9cc-wvrl9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

Started

Container started

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 6 to 10

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulCreate

Created pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

ProbeError

Startup probe error: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

Unhealthy

Startup probe failed: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

ProbeError

Startup probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

ProbeError

Startup probe error: Get "http://10.134.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

Unhealthy

Startup probe failed: Get "http://10.134.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

ProbeError

Startup probe error: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

Unhealthy

Startup probe failed: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

ProbeError

Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d84f47-68f6ff8b56-hrf5l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d84f47-7d4688cc47-8wdvj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

Unhealthy

Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulDelete

Deleted pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-db46h

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 6 to 5
(x2)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

ProbeError

Startup probe error: Get "http://10.134.0.150:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5ba2ef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5ba2ef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

Unhealthy

Startup probe failed: Get "http://10.134.0.150:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

ProbeError

Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x2)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

Unhealthy

Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 6 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-d84f47-openshift-default-76dcd5c7b5-st9zk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5ba2ef-76df498cd6-lg7zt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5ba2ef-68d98d98cf-2c9fb

Killing

Stopping container payload-pre-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng

ProbeError

Startup probe error: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng

Unhealthy

Startup probe failed: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-fjpwf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f9c553-openshift-default-77f8888997-tpdvl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-5ba2ef-openshift-default-555b66d977-4f27c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulCreate

Created pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

Started

Container started

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ffbba3-79b8659d9d-wjmvq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ffbba3-56d7db84c5-rhb58

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ffbba3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

ProbeError

Startup probe error: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

Unhealthy

Startup probe failed: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ffbba3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

ProbeError

Startup probe error: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

Unhealthy

Startup probe failed: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76c107-59f7896687-s2tf2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76c107-86c5c947d8-dh4hf

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 6 to 10

openshift-ingress

kubelet

e2e-praxis-b-ffbba3-openshift-default-6978cc47b5-7kwng

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulCreate

Created pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

Started

Container started

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

Created

Container created

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

Created

Container created

openshift-ingress

multus

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-76c107-openshift-default-69f98c49-8gnzx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-2fdf91-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-2fdf91-openshift-default-575c5986c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-2fdf91-openshift-default-575c5986c7

SuccessfulCreate

Created pod: e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-2fdf91

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-2fdf91

openshift-ingress

multus

e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

ProbeError

Startup probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

Unhealthy

Startup probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

ProbeError

Startup probe error: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

Unhealthy

Startup probe failed: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

Unhealthy

Readiness probe failed: Get "http://10.132.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

ProbeError

Readiness probe error: Get "http://10.132.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2fdf91-6d85599cb8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2fdf91: serviceaccount "payload-processing-e2e-praxis-a-2fdf91" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2fdf91: serviceaccount "payload-processing-e2e-praxis-a-2fdf91" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-2fdf91

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-2fdf91-6d85599cb8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-2fdf91

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2fdf91-6d85599cb8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-dntxx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-wtbdj

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-wtbdj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-wtbdj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-dntxx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-dntxx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-dntxx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-wtbdj

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-wtbdj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-dntxx

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes
(x3)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

Unhealthy

Startup probe failed: Get "http://10.132.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

ProbeError

Startup probe error: Get "http://10.132.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-e9cb4a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-e9cb4a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-e9cb4a

openshift-ingress

replicaset-controller

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c

SuccessfulCreate

Created pod: e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

openshift-ingress

multus

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e9cb4a: serviceaccount "payload-processing-e2e-shared-a-w2-e9cb4a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-vvrg6

openshift-ingress

deployment-controller

e2e-shared-a-w4-7a8b38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e9cb4a: serviceaccount "payload-processing-e2e-shared-a-w2-e9cb4a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-xxh4w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-e9cb4a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-7a8b38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-7a8b38

openshift-ingress

replicaset-controller

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97

SuccessfulCreate

Created pod: e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-e9cb4a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-vvrg6

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-vvrg6

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-vvrg6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-vvrg6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-xxh4w

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-xxh4w

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-xxh4w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-xxh4w

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-517a25

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-517a25

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-fks52

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-hxkhh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-sjm4f

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulDelete

Deleted pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-nc8rb

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulDelete

Deleted pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 5 to 4

openshift-ingress

replicaset-controller

e2e-shared-a-w0-517a25-openshift-default-66996c9485

SuccessfulCreate

Created pod: e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

openshift-ingress

deployment-controller

e2e-shared-a-w0-517a25-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-517a25-openshift-default-66996c9485 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

multus

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-7a8b38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

Unhealthy

Readiness probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-7a8b38: serviceaccount "payload-processing-e2e-shared-a-w4-7a8b38" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-h2shk
(x7)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

Unhealthy

Readiness probe failed: Get "https://10.134.0.44:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-czsrx
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-7a8b38: serviceaccount "payload-processing-e2e-shared-a-w4-7a8b38" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-7a8b38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-fks52

ProbeError

Readiness probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

ProbeError

Readiness probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-sjm4f

Unhealthy

Readiness probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

ProbeError

Readiness probe error: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-l9js2

Unhealthy

Readiness probe failed: Get "https://10.134.0.43:8000/ready": context deadline exceeded
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-hxkhh

Unhealthy

Readiness probe failed: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9zzbc

Unhealthy

Readiness probe failed: Get "https://10.134.0.44:8000/ready": context deadline exceeded
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-pnkfq

Unhealthy

Readiness probe failed: Get "https://10.134.0.41:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

Unhealthy

Readiness probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-xr84b

ProbeError

Readiness probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-9rg6h

Unhealthy

Readiness probe failed: Get "https://10.134.0.40:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

Unhealthy

Readiness probe failed: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

ProbeError

Readiness probe error: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-czsrx

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-517a25

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-517a25-67d96956bb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-h2shk

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-h2shk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-517a25-67d96956bb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-517a25-67d96956bb-p7jgq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-517a25-67d96956bb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-517a25-67d96956bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-517a25: serviceaccount "payload-processing-e2e-shared-a-w0-517a25" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-czsrx

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-517a25: serviceaccount "payload-processing-e2e-shared-a-w0-517a25" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-czsrx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-nmcmp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-517a25

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-h2shk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-czsrx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-h2shk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-nmcmp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-517a25-67d96956bb-p7jgq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-nmcmp

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-nmcmp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-nmcmp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-517a25-67d96956bb-p7jgq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-517a25-67d96956bb-p7jgq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-517a25-67d96956bb-p7jgq

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ca097a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ca097a

openshift-ingress

multus

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-ca097a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ca097a-openshift-default-7478b86885 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-ca097a-openshift-default-7478b86885

SuccessfulCreate

Created pod: e2e-praxis-b-ca097a-openshift-default-7478b86885-578km
(x5)

openshift-ingress

kubelet

e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ca097a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ca097a-868bdd8cdd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ca097a-868bdd8cdd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ca097a-868bdd8cdd-jmz5h

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-bd2aaf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-bd2aaf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ca097a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95-ldc2m
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ca097a: serviceaccount "payload-processing-e2e-praxis-b-ca097a" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ca097a-868bdd8cdd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ca097a-868bdd8cdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ca097a: serviceaccount "payload-processing-e2e-praxis-b-ca097a" not found

openshift-ingress

deployment-controller

e2e-shared-a-w1-bd2aaf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ca097a-868bdd8cdd-jmz5h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-ca097a-868bdd8cdd-jmz5h

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95-ldc2m

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95-ldc2m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ca097a-868bdd8cdd-jmz5h

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69

SuccessfulCreate

Created pod: e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95-ldc2m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ca097a-868bdd8cdd-jmz5h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95-ldc2m

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-bd2aaf: serviceaccount "payload-processing-e2e-shared-a-w1-bd2aaf" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-bd2aaf: serviceaccount "payload-processing-e2e-shared-a-w1-bd2aaf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-bd2aaf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-bd2aaf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-t7bcj

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-517a25-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-t7bcj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-rn6ng

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-t7bcj

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-t7bcj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-t7bcj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-rn6ng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-517a25-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-rn6ng

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-rn6ng

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-rn6ng

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2fdf91-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c

SuccessfulCreate

Created pod: e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-92855c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-92855c
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2fdf91-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w2-92855c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w4-98dabb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-98dabb-openshift-default-778885789c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-98dabb-openshift-default-778885789c

SuccessfulCreate

Created pod: e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-98dabb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-98dabb

openshift-ingress

multus

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-92855c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-92855c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-xjn52

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-xjn52

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-grmdx

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-grmdx

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-grmdx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-xjn52
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-92855c: serviceaccount "payload-processing-e2e-shared-b-w2-92855c" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-xjn52

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-grmdx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-grmdx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-xjn52

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-92855c: serviceaccount "payload-processing-e2e-shared-b-w2-92855c" not found

openshift-ingress

kubelet

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

Unhealthy

Readiness probe failed: Get "http://10.133.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

ProbeError

Readiness probe error: Get "http://10.133.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-98dabb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-98dabb: serviceaccount "payload-processing-e2e-shared-b-w4-98dabb" not found

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

ProbeError

Readiness probe error: Get "http://10.134.0.159:15021/healthz/ready": read tcp 10.134.0.2:40166->10.134.0.159:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-98dabb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-98dabb: serviceaccount "payload-processing-e2e-shared-b-w4-98dabb" not found

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

Unhealthy

Readiness probe failed: Get "http://10.134.0.159:15021/healthz/ready": read tcp 10.134.0.2:40166->10.134.0.159:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-s7l69

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-87vkq

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-s7l69
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-87vkq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-s7l69

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-s7l69

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-s7l69

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-87vkq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-87vkq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-87vkq

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2fdf91-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2fdf91-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-241ffa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-241ffa

openshift-ingress

deployment-controller

e2e-shared-b-w0-241ffa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f

SuccessfulCreate

Created pod: e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

openshift-ingress

multus

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

ProbeError

Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

Unhealthy

Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

ProbeError

Startup probe error: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

Unhealthy

Startup probe failed: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-241ffa: serviceaccount "payload-processing-e2e-shared-b-w0-241ffa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-241ffa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-241ffa-8ffc69466 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-241ffa-8ffc69466

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-241ffa: serviceaccount "payload-processing-e2e-shared-b-w0-241ffa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-hlbp6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-241ffa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-241ffa-8ffc69466

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-rv2p4

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-rv2p4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-rv2p4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-hlbp6

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-rv2p4

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-rv2p4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-hlbp6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-hlbp6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-hlbp6

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulDelete

Deleted pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-t696w

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 7 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-zzxjs

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-t696w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

ProbeError

Startup probe error: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

Unhealthy

Startup probe failed: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ca097a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ca097a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w1-71fbeb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669

SuccessfulCreate

Created pod: e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-71fbeb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-71fbeb

openshift-ingress

multus

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-71fbeb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-71fbeb: serviceaccount "payload-processing-e2e-shared-b-w1-71fbeb" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-71fbeb: serviceaccount "payload-processing-e2e-shared-b-w1-71fbeb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-71fbeb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-tcp75
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7a8b38-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-g5ppw

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-g5ppw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-g5ppw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-tcp75

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-g5ppw

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7a8b38-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-tcp75

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-tcp75

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-g5ppw

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-tcp75

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

ProbeError

Readiness probe error: Get "http://10.133.0.149:15021/healthz/ready": read tcp 10.133.0.2:58954->10.133.0.149:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

Unhealthy

Readiness probe failed: Get "http://10.133.0.149:15021/healthz/ready": read tcp 10.133.0.2:58954->10.133.0.149:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-517a25-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-517a25-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ca097a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ca097a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-e9cb4a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-e9cb4a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-92855c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-92855c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

ProbeError

Startup probe error: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

Unhealthy

Startup probe failed: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-bd2aaf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-bd2aaf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

Unhealthy

Readiness probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

ProbeError

Readiness probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-92855c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-92855c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-241ffa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-241ffa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

ProbeError

Startup probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

Unhealthy

Startup probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-bd2aaf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-bd2aaf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-241ffa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-241ffa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-98dabb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-98dabb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulDelete

Deleted pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

ProbeError

Readiness probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-j4ts8

Unhealthy

Readiness probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

ProbeError

Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

Unhealthy

Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71fbeb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71fbeb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71fbeb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-71fbeb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 6 to 5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-mzhxg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-mzhxg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-dntxx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-wtbdj

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2fdf91-7bf7c4c4f9-wtbdj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2fdf91-6d85599cb8-dntxx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-a-2fdf91-openshift-default-575c5986c7-s6jpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ca097a-868bdd8cdd-jmz5h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ca097a-6fbcf4f95-ldc2m

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulDelete

Deleted pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-fsgtl

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 10 to 6

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lk7fk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-lb4nk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-f7bb2

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-jn47c

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-wwm5g
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-gt7rp
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 10 to 6

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-11535-cc7e99

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11535-cc7e99

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

multus

test-curl-11535-cc7e99

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-c5jnr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-11535-cc7e99

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57bjm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-ca097a-openshift-default-7478b86885-578km

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-11535-e19d44

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11535-e19d44

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11535-cc7e99

Killing

Stopping container test-curl-11535-cc7e99

opendatahub

kubelet

test-curl-11535-e19d44

Started

Container started

opendatahub

kubelet

test-curl-11535-e19d44

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-f49b40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-f49b40

opendatahub

kubelet

test-curl-11535-e19d44

Killing

Stopping container test-curl-11535-e19d44

openshift-ingress

deployment-controller

e2e-shared-a-w3-f49b40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-f49b40-openshift-default-54759894c5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-f49b40-openshift-default-54759894c5

SuccessfulCreate

Created pod: e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth

openshift-ingress

multus

e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-f49b40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-xppfw

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-f49b40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f49b40: serviceaccount "payload-processing-e2e-shared-a-w3-f49b40" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f49b40: serviceaccount "payload-processing-e2e-shared-a-w3-f49b40" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-vqj2x

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-vqj2x

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-vqj2x

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-xppfw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-xppfw

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-xppfw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-xppfw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-vqj2x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-vqj2x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-f49b40-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-f49b40-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xrq4r

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 10 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-qtjv7

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-8mg6p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-xcz4d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-glqmj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-qtjv7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-noten-f1af9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f1af9c-openshift-default-695c446b69 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-f1af9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f1af9c

openshift-ingress

replicaset-controller

e2e-noten-f1af9c-openshift-default-695c446b69

SuccessfulCreate

Created pod: e2e-noten-f1af9c-openshift-default-695c446b69-w72kh

openshift-ingress

kubelet

e2e-noten-f1af9c-openshift-default-695c446b69-w72kh

Started

Container started

openshift-ingress

kubelet

e2e-noten-f1af9c-openshift-default-695c446b69-w72kh

Created

Container created

openshift-ingress

kubelet

e2e-noten-f1af9c-openshift-default-695c446b69-w72kh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-f1af9c-openshift-default-695c446b69-w72kh

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulDelete

Deleted pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-xzjs5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-57qt5

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-b9mql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-f1af9c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-f1af9c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

test-curl-11526-26aa70

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11526-26aa70

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11526-26aa70

Started

Container started

opendatahub

kubelet

test-curl-11526-26aa70

Created

Container created

opendatahub

kubelet

test-curl-11526-26aa70

Killing

Stopping container test-curl-11526-26aa70

openshift-ingress

kubelet

e2e-noten-f1af9c-openshift-default-695c446b69-w72kh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-f1af9c-openshift-default-695c446b69-w72kh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-f1af9c-openshift-default-695c446b69-w72kh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-explicit-182377

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-182377

openshift-ingress

deployment-controller

e2e-explicit-182377-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-182377-openshift-default-5d6bc8dfc7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-182377-openshift-default-5d6bc8dfc7

SuccessfulCreate

Created pod: e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp

openshift-ingress

multus

e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-451a21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-451a21

openshift-ingress

multus

e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-451a21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-451a21-openshift-default-c48d9fc87 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-451a21-openshift-default-c48d9fc87

SuccessfulCreate

Created pod: e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-182377

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-182377-5769fc56b6 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-7cq2v

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 4 to 3

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-vgv9r

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-182377-69d79f5db7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-182377-69d79f5db7-lfjhg

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-182377-5769fc56b6

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-182377-5769fc56b6-h4sdv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-182377-5769fc56b6

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-182377-5769fc56b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-182377: serviceaccount "payload-processing-e2e-explicit-182377" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-182377-69d79f5db7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-182377-69d79f5db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-182377: serviceaccount "payload-processing-e2e-explicit-182377" not found

openshift-ingress

multus

payload-processing-e2e-explicit-182377-5769fc56b6-h4sdv

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-182377

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-182377-69d79f5db7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-182377-5769fc56b6-h4sdv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-182377-69d79f5db7-lfjhg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-182377-69d79f5db7-lfjhg

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-5f4ks

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-182377-69d79f5db7-lfjhg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-182377-5769fc56b6-h4sdv

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-182377-69d79f5db7-lfjhg

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-explicit-182377-5769fc56b6-h4sdv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7cq2v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-451a21

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-451a21-7f55f6f596 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-451a21

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-451a21-7f55f6f596

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-jpx5x
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-451a21: serviceaccount "payload-processing-e2e-shared-b-w3-451a21" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-qd57l

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-qd57l

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-qd57l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-jpx5x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-qd57l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-qd57l

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-jpx5x

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-jpx5x

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-451a21-7f55f6f596

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-451a21: serviceaccount "payload-processing-e2e-shared-b-w3-451a21" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-jpx5x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth

ProbeError

Startup probe error: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth

Unhealthy

Startup probe failed: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-551dd1-openshift-default-8479fbc77f

SuccessfulDelete

Deleted pod: e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

openshift-ingress

gateway_labeler_controller

e2e-autores-037a5a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-037a5a

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

deployment-controller

e2e-worker-w3-551dd1-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-551dd1-openshift-default-8479fbc77f from 2 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-551dd1-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-autores-037a5a-openshift-default-6d5b9745cc

SuccessfulCreate

Created pod: e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-6cq8h

openshift-ingress

deployment-controller

e2e-autores-037a5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-037a5a-openshift-default-6d5b9745cc from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 5 to 4

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-7lndq

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-2v66b

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

payload-processing-e2e-autores-037a5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-037a5a-6596f65f9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-037a5a-768dd867bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-037a5a-768dd867bc-hw9cz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-037a5a-6596f65f9d

FailedCreate

Error creating: pods "payload-processing-e2e-autores-037a5a-6596f65f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-037a5a: serviceaccount "payload-processing-e2e-autores-037a5a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-037a5a-768dd867bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-037a5a-768dd867bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-037a5a: serviceaccount "payload-processing-e2e-autores-037a5a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-037a5a-768dd867bc-hw9cz

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-autores-037a5a-768dd867bc-hw9cz

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-037a5a-768dd867bc-hw9cz

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-037a5a-6596f65f9d

SuccessfulCreate

Created pod: payload-processing-e2e-autores-037a5a-6596f65f9d-mrw4g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-037a5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-037a5a-768dd867bc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-037a5a-768dd867bc-hw9cz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-037a5a-6596f65f9d-mrw4g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-autores-037a5a-6596f65f9d-mrw4g

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-037a5a-6596f65f9d-mrw4g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-037a5a-6596f65f9d-mrw4g

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-f49b40-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-f49b40-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-a-1957dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-1957dc-openshift-default-7d8748ffcc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-1957dc-openshift-default-7d8748ffcc

SuccessfulCreate

Created pod: e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-1957dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-1957dc

openshift-ingress

multus

e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-m5qkl

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-1957dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-1957dc-6774bd598b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-1957dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-1957dc: serviceaccount "payload-processing-e2e-extmod-a-1957dc" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-1957dc-6774bd598b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-1957dc-6774bd598b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-1957dc: serviceaccount "payload-processing-e2e-extmod-a-1957dc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-1957dc-6774bd598b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-1957dc-6774bd598b-xb4k4

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-m5qkl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-m5qkl

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-m5qkl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-m5qkl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1957dc-6774bd598b-xb4k4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1957dc-6774bd598b-xb4k4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1957dc-6774bd598b-xb4k4

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-1957dc-6774bd598b-xb4k4

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11532-b7a498

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11532-b7a498

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11532-b7a498

Created

Container created

opendatahub

kubelet

test-curl-11532-b7a498

Started

Container started

opendatahub

kubelet

test-curl-11532-7b026e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11532-7b026e

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11532-7b026e

Started

Container started

opendatahub

kubelet

test-curl-11532-b7a498

Killing

Stopping container test-curl-11532-b7a498

opendatahub

kubelet

test-curl-11532-7b026e

Created

Container created

opendatahub

kubelet

test-curl-11532-8efc6a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11532-8efc6a

Created

Container created

opendatahub

kubelet

test-curl-11532-7b026e

Killing

Stopping container test-curl-11532-7b026e

opendatahub

kubelet

test-curl-11532-8efc6a

Started

Container started

opendatahub

multus

test-curl-11532-8efc6a

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

opendatahub

multus

test-curl-11532-8333e1

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11532-8333e1

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11532-8333e1

Created

Container created

opendatahub

kubelet

test-curl-11532-8333e1

Started

Container started

opendatahub

kubelet

test-curl-11532-8efc6a

Killing

Stopping container test-curl-11532-8efc6a

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-11532-8333e1

Killing

Stopping container test-curl-11532-8333e1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-c9zzq

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-63499e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-63499e

openshift-ingress

replicaset-controller

e2e-extmod-a-63499e-openshift-default-6df6b584fc

SuccessfulCreate

Created pod: e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

openshift-ingress

deployment-controller

e2e-extmod-a-63499e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-63499e-openshift-default-6df6b584fc from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-k4j4b

openshift-ingress

multus

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-63499e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-63499e-5dd54b859b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-63499e: serviceaccount "payload-processing-e2e-extmod-a-63499e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-c2llr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-63499e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-63499e-5dd54b859b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-63499e-5dd54b859b-c22tf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-63499e-5dd54b859b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-63499e-5dd54b859b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-63499e: serviceaccount "payload-processing-e2e-extmod-a-63499e" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-63499e-5dd54b859b-c22tf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-63499e-5dd54b859b-c22tf

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-63499e-5dd54b859b-c22tf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-63499e-5dd54b859b-c22tf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-c2llr

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-c2llr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-c2llr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-c2llr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-rd49z
(x5)

openshift-ingress

kubelet

e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp

Unhealthy

Startup probe failed: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 3 to 2
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp

ProbeError

Startup probe error: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rd49z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-182377-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-182377-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-4db150-openshift-default-75fddffd6f

SuccessfulCreate

Created pod: e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

openshift-ingress

deployment-controller

e2e-extmod-a-4db150-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-4db150-openshift-default-75fddffd6f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-4db150

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-4db150
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-451a21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-451a21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-4db150

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-4db150

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-4db150-679bfc745b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4db150-679bfc745b-h5cx5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-4db150: serviceaccount "payload-processing-e2e-extmod-a-4db150" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-9dg75

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-4db150-679bfc745b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-4db150-679bfc745b-h5cx5

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-9dg75

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4db150-679bfc745b-h5cx5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4db150-679bfc745b-h5cx5

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-4db150-679bfc745b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-4db150-679bfc745b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-4db150: serviceaccount "payload-processing-e2e-extmod-a-4db150" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-9dg75

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-9dg75

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-9dg75

openshift-ingress

multus

payload-processing-e2e-extmod-a-4db150-679bfc745b-h5cx5

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-182377-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-182377-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-451a21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-451a21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-037a5a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-037a5a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-182377-5769fc56b6-h4sdv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-182377-69d79f5db7-lfjhg

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2

Unhealthy

Startup probe failed: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2

ProbeError

Startup probe error: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1957dc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1957dc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-2d2a0b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-2d2a0b

openshift-ingress

deployment-controller

e2e-extmod-b-2d2a0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77

SuccessfulCreate

Created pod: e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7

openshift-ingress

multus

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-2d2a0b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-wlpck

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-2d2a0b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2d2a0b: serviceaccount "payload-processing-e2e-extmod-b-2d2a0b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-7w5vb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2d2a0b: serviceaccount "payload-processing-e2e-extmod-b-2d2a0b" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-7w5vb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-wlpck

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-wlpck

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-7w5vb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-wlpck

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-7w5vb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-wlpck

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-7w5vb

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-037a5a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-037a5a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-63499e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-63499e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

Unhealthy

Startup probe failed: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

ProbeError

Startup probe error: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-autores-037a5a-6596f65f9d-mrw4g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-037a5a-768dd867bc-hw9cz

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-8740d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-8740d4-openshift-default-79ccb5884f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-8740d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-8740d4

openshift-ingress

replicaset-controller

e2e-extmod-b-8740d4-openshift-default-79ccb5884f

SuccessfulCreate

Created pod: e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1957dc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1957dc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-8740d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-8740d4-59db5fb696 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-8740d4-59db5fb696

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-8740d4-59db5fb696-7b579

openshift-ingress

multus

payload-processing-e2e-extmod-b-8740d4-59db5fb696-7b579

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-8740d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-8740d4-675f87d779 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-8740d4-675f87d779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-szvh5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-8740d4-59db5fb696

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-8740d4-59db5fb696-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-8740d4: serviceaccount "payload-processing-e2e-extmod-b-8740d4" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-8740d4-675f87d779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-8740d4: serviceaccount "payload-processing-e2e-extmod-b-8740d4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-szvh5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8740d4-59db5fb696-7b579

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-szvh5

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-szvh5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-szvh5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8740d4-59db5fb696-7b579

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8740d4-59db5fb696-7b579

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-explicit-182377-openshift-default-5d6bc8dfc7-8lkvp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-acf9e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-acf9e2

openshift-ingress

replicaset-controller

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9

SuccessfulCreate

Created pod: e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

openshift-ingress

deployment-controller

e2e-extmod-a-acf9e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

ProbeError

Startup probe error: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

Unhealthy

Startup probe failed: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-acf9e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-acf9e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-acf9e2: serviceaccount "payload-processing-e2e-extmod-a-acf9e2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-acf9e2: serviceaccount "payload-processing-e2e-extmod-a-acf9e2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-667ht

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-667ht

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-slg62

openshift-ingress

multus

payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-slg62

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-667ht

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-slg62

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-667ht

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-slg62

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-slg62

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-667ht

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-63499e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-63499e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-75d385-openshift-default-8785c777c

SuccessfulCreate

Created pod: e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-75d385

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-75d385

openshift-ingress

deployment-controller

e2e-extmod-b-75d385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-75d385-openshift-default-8785c777c from 0 to 1

openshift-ingress

multus

e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-75d385-5d5cdd6f58

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-75d385: serviceaccount "payload-processing-e2e-extmod-b-75d385" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-75d385

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-75d385-5d5cdd6f58 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-75d385

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-75d385-67669b7955 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-75d385-67669b7955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-75d385-67669b7955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-75d385: serviceaccount "payload-processing-e2e-extmod-b-75d385" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-75d385-67669b7955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-75d385-67669b7955-t2gd5

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-fbfm8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-fbfm8

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-75d385-5d5cdd6f58

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-fbfm8

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-75d385-67669b7955-t2gd5

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-75d385-67669b7955-t2gd5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-75d385-67669b7955-t2gd5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-75d385-67669b7955-t2gd5

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4db150-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-fbfm8

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4db150-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-fbfm8

Created

Container created

openshift-ingress

kubelet

e2e-autores-037a5a-openshift-default-6d5b9745cc-6wkwk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-0505b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-0505b0

openshift-ingress

replicaset-controller

e2e-extmod-a-0505b0-openshift-default-d499f445

SuccessfulCreate

Created pod: e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

openshift-ingress

deployment-controller

e2e-extmod-a-0505b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-0505b0-openshift-default-d499f445 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-0505b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-ddsdz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0505b0: serviceaccount "payload-processing-e2e-extmod-a-0505b0" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4db150-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4db150-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-0505b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-0505b0-7d58478d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0505b0-7d58478d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-0505b0-7d58478d-dqfnx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0505b0-7d58478d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-0505b0-7d58478d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0505b0: serviceaccount "payload-processing-e2e-extmod-a-0505b0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-ddsdz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-0505b0-7d58478d-dqfnx

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-ddsdz

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-ddsdz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-ddsdz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0505b0-7d58478d-dqfnx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0505b0-7d58478d-dqfnx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0505b0-7d58478d-dqfnx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7

ProbeError

Startup probe error: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7

Unhealthy

Startup probe failed: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d2a0b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d2a0b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2

Unhealthy

Startup probe failed: Get "http://10.134.0.196:15021/healthz/ready": dial tcp 10.134.0.196:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2

ProbeError

Startup probe error: Get "http://10.134.0.196:15021/healthz/ready": dial tcp 10.134.0.196:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d2a0b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d2a0b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8740d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8740d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

Unhealthy

Readiness probe failed: Get "http://10.134.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

ProbeError

Readiness probe error: Get "http://10.134.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-75d385-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-75d385-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp

Unhealthy

Startup probe failed: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

ProbeError

Startup probe error: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

Unhealthy

Startup probe failed: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp

ProbeError

Startup probe error: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8740d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8740d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-88e9f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-88e9f3

openshift-ingress

replicaset-controller

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc

SuccessfulCreate

Created pod: e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

openshift-ingress

deployment-controller

e2e-extmod-b-88e9f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-88e9f3-openshift-default-68c959b4cc from 0 to 1

openshift-ingress

multus

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-88e9f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-c4w2w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-88e9f3: serviceaccount "payload-processing-e2e-extmod-b-88e9f3" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-75d385-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-88e9f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-c4w2w
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-88e9f3: serviceaccount "payload-processing-e2e-extmod-b-88e9f3" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-bg4xq

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-bg4xq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-c4w2w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-c4w2w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-bg4xq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-c4w2w

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-bg4xq

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-75d385-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-bg4xq
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-acf9e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-acf9e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-pt9z9
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-0d9115-openshift-default-856bf8bb69

SuccessfulCreate

Created pod: e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0d9115

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0d9115
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-b-0d9115-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0d9115-openshift-default-856bf8bb69 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

Unhealthy

Startup probe failed: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

ProbeError

Startup probe error: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0d9115: serviceaccount "payload-processing-e2e-extmod-b-0d9115" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0d9115: serviceaccount "payload-processing-e2e-extmod-b-0d9115" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-9jmmc

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0d9115

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-6ts5w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0d9115

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-6ts5w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-6ts5w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-9jmmc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-9jmmc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-9jmmc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-6ts5w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-6ts5w

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-9jmmc

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0505b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0505b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-88e9f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-88e9f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

Unhealthy

Startup probe failed: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

ProbeError

Startup probe error: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused body:
(x4)

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-8c4jl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-kt8ct

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d9115-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d9115-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-88e9f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-88e9f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c

ProbeError

Startup probe error: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c

Unhealthy

Startup probe failed: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

AddedInterface

Add eth0 [10.133.0.196/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-75d385-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-75d385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-75d385-openshift-default-8785c777c from 1 to 2

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-75d385-openshift-default-8785c777c

SuccessfulCreate

Created pod: e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d9115-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d9115-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

Unhealthy

Startup probe failed: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

ProbeError

Startup probe error: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-63499e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-63499e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-63499e-openshift-default-6df6b584fc from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-a-63499e-openshift-default-6df6b584fc

SuccessfulCreate

Created pod: e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

Unhealthy

Startup probe failed: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

ProbeError

Startup probe error: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-797f94cb56 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-797f94cb56

FailedCreate

Error creating: pods "payload-processing-external-model-797f94cb56-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-797f94cb56-9wjnt

Started

Container started

models-as-a-service

multus

payload-processing-external-model-797f94cb56-9wjnt

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-797f94cb56

SuccessfulCreate

Created pod: payload-processing-external-model-797f94cb56-9wjnt

models-as-a-service

kubelet

payload-processing-external-model-797f94cb56-9wjnt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-797f94cb56-9wjnt

Created

Container created

models-as-a-service

multus

payload-processing-external-model-6fdcbd645b-d9lrk

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6fdcbd645b-d9lrk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-6fdcbd645b

SuccessfulCreate

Created pod: payload-processing-external-model-6fdcbd645b-d9lrk

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6fdcbd645b from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-6fdcbd645b-d9lrk

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6fdcbd645b-d9lrk

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6fdcbd645b-d9lrk

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-6fdcbd645b

SuccessfulDelete

Deleted pod: payload-processing-external-model-6fdcbd645b-d9lrk

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6fdcbd645b from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-797f94cb56-9wjnt

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7f64b5b66

SuccessfulCreate

Created pod: payload-processing-external-model-7f64b5b66-lh4pd

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7f64b5b66 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-7f64b5b66

FailedCreate

Error creating: pods "payload-processing-external-model-7f64b5b66-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-7f64b5b66-lh4pd

Created

Container created

models-as-a-service

multus

payload-processing-external-model-7f64b5b66-lh4pd

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7f64b5b66-lh4pd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7f64b5b66-lh4pd

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7f64b5b66-lh4pd

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-7jlq7
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-7f64b5b66

FailedCreate

Error creating: pods "payload-processing-external-model-7f64b5b66-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-57f78bcd55 from 2 to 4

models-as-a-service

replicaset-controller

payload-processing-external-model-7f64b5b66

SuccessfulCreate

Created pod: payload-processing-external-model-7f64b5b66-rhn46

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7f64b5b66 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-k879q

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-k879q

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7f64b5b66-rhn46

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7jlq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7f64b5b66-rhn46

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-7jlq7

AddedInterface

Add eth0 [10.134.0.224/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7f64b5b66-rhn46

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7jlq7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7f64b5b66-rhn46

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7jlq7

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7f64b5b66-rhn46

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7jlq7

Unhealthy

Startup probe failed: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7jlq7

ProbeError

Startup probe error: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

ProbeError

Startup probe error: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

Unhealthy

Startup probe failed: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

ProbeError

Startup probe error: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

Unhealthy

Startup probe failed: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-jhgnx
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-57f78bcd55 from 4 to 6

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-jhgnx

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-p95xn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-p95xn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-p95xn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-jhgnx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-jhgnx

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-p95xn

AddedInterface

Add eth0 [10.134.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-jhgnx

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-p95xn
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-p95xn

ProbeError

Startup probe error: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-jhgnx

ProbeError

Startup probe error: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-jhgnx

Unhealthy

Startup probe failed: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-p95xn

Unhealthy

Startup probe failed: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-77b6j

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-77b6j

AddedInterface

Add eth0 [10.133.0.212/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-28wtn

AddedInterface

Add eth0 [10.132.1.18/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-57f78bcd55 from 6 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-28wtn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-77b6j

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-28wtn

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-77b6j

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-28wtn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-77b6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-28wtn

Started

Container started
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-77b6j

ProbeError

Startup probe error: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-77b6j

Unhealthy

Startup probe failed: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-77b6j

Unhealthy

Startup probe failed: Get "http://10.133.0.212:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-77b6j

ProbeError

Startup probe error: Get "http://10.133.0.212:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

ProbeError

Readiness probe error: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-zgkz8

Unhealthy

Readiness probe failed: Get "http://10.132.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-28wtn

Unhealthy

Startup probe failed: Get "http://10.132.1.18:15021/healthz/ready": dial tcp 10.132.1.18:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-28wtn

ProbeError

Startup probe error: Get "http://10.132.1.18:15021/healthz/ready": dial tcp 10.132.1.18:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

Unhealthy

Readiness probe failed: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

ProbeError

Readiness probe error: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-q8crv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-q8crv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-q8crv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-czngj

AddedInterface

Add eth0 [10.132.1.23/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-czngj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-q8crv

AddedInterface

Add eth0 [10.134.0.234/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-q8crv

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-czngj
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-czngj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-czngj

Created

Container created
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-q8crv

Unhealthy

Startup probe failed: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-czngj

ProbeError

Startup probe error: Get "http://10.132.1.23:15021/healthz/ready": dial tcp 10.132.1.23:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-czngj

Unhealthy

Startup probe failed: Get "http://10.132.1.23:15021/healthz/ready": dial tcp 10.132.1.23:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-q8crv

ProbeError

Startup probe error: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-5cc5856c6b

SuccessfulCreate

Created pod: payload-processing-external-model-5cc5856c6b-765qs
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5cc5856c6b

FailedCreate

Error creating: pods "payload-processing-external-model-5cc5856c6b-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5cc5856c6b from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5cc5856c6b-765qs

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5cc5856c6b-765qs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5cc5856c6b-765qs

Started

Container started

models-as-a-service

multus

payload-processing-external-model-5cc5856c6b-765qs

AddedInterface

Add eth0 [10.132.1.26/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5cc5856c6b-765qs

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-inf-a-d41320-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d41320-openshift-default-9c8899ff9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-d41320-openshift-default-9c8899ff9

SuccessfulCreate

Created pod: e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d41320

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d41320

openshift-ingress

multus

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

AddedInterface

Add eth0 [10.132.1.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d41320-687fb8bd99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-pz64d

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-pz64d

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d41320

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d41320-687fb8bd99 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d41320-687fb8bd99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d41320: serviceaccount "payload-processing-e2e-inf-a-d41320" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d41320

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d41320-6fbcbd98fb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d41320-6fbcbd98fb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d41320-6fbcbd98fb-8kmvg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d41320-6fbcbd98fb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d41320-6fbcbd98fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d41320: serviceaccount "payload-processing-e2e-inf-a-d41320" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-d41320-6fbcbd98fb-8kmvg

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d41320-6fbcbd98fb-8kmvg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d41320-6fbcbd98fb-8kmvg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-pz64d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-pz64d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-pz64d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d41320-6fbcbd98fb-8kmvg

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-a-9cc0e6-openshift-default-5459db5bff

SuccessfulCreate

Created pod: e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

openshift-ingress

deployment-controller

e2e-inf-a-9cc0e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-9cc0e6-openshift-default-5459db5bff from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-9cc0e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-9cc0e6

openshift-ingress

multus

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

AddedInterface

Add eth0 [10.132.1.33/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9cc0e6: serviceaccount "payload-processing-e2e-inf-a-9cc0e6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-qpthf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-9cc0e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-9cc0e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-9cc0e6-6557cfd444 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9cc0e6-6557cfd444

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-9cc0e6-6557cfd444-9ltnx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9cc0e6-6557cfd444

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-9cc0e6-6557cfd444-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9cc0e6: serviceaccount "payload-processing-e2e-inf-a-9cc0e6" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9cc0e6-6557cfd444-9ltnx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9cc0e6-6557cfd444-9ltnx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-qpthf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-qpthf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-qpthf

AddedInterface

Add eth0 [10.134.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9cc0e6-6557cfd444-9ltnx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-qpthf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-9cc0e6-6557cfd444-9ltnx

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-0d9115-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0d9115-openshift-default-856bf8bb69 from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-0d9115-openshift-default-856bf8bb69

SuccessfulCreate

Created pod: e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d9115-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

Unhealthy

Startup probe failed: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

ProbeError

Startup probe error: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-a-22efcf-openshift-default-778dff5c67

SuccessfulCreate

Created pod: e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

openshift-ingress

gateway_labeler_controller

e2e-inf-a-22efcf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-22efcf

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ba646b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ba646b

openshift-ingress

deployment-controller

e2e-inf-a-22efcf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-22efcf-openshift-default-778dff5c67 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-ba646b-openshift-default-5b5998b9ff

SuccessfulCreate

Created pod: e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

openshift-ingress

deployment-controller

e2e-inf-b-ba646b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ba646b-openshift-default-5b5998b9ff from 0 to 1

openshift-ingress

multus

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

AddedInterface

Add eth0 [10.132.1.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

AddedInterface

Add eth0 [10.132.1.36/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

Unhealthy

Startup probe failed: Get "http://10.132.1.28:15021/healthz/ready": dial tcp 10.132.1.28:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

ProbeError

Startup probe error: Get "http://10.132.1.28:15021/healthz/ready": dial tcp 10.132.1.28:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ba646b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ba646b-597b979dd4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ba646b-597b979dd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ba646b: serviceaccount "payload-processing-e2e-inf-b-ba646b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ba646b-597b979dd4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ba646b-597b979dd4-4fxpc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ba646b: serviceaccount "payload-processing-e2e-inf-b-ba646b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ba646b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ba646b-597b979dd4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-vx7jm

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ba646b-597b979dd4-4fxpc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-vx7jm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ba646b-597b979dd4-4fxpc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-vx7jm

AddedInterface

Add eth0 [10.134.0.241/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-ba646b-597b979dd4-4fxpc

AddedInterface

Add eth0 [10.134.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ba646b-597b979dd4-4fxpc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-vx7jm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-vx7jm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-22efcf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-22efcf-6bccb7db6d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-22efcf-6bccb7db6d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-22efcf-6bccb7db6d-gwdxh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-22efcf: serviceaccount "payload-processing-e2e-inf-a-22efcf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-hjhfm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-22efcf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-hjhfm

AddedInterface

Add eth0 [10.134.0.243/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-22efcf-6bccb7db6d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-22efcf-6bccb7db6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-22efcf: serviceaccount "payload-processing-e2e-inf-a-22efcf" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-22efcf-6bccb7db6d-gwdxh

AddedInterface

Add eth0 [10.134.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-22efcf-6bccb7db6d-gwdxh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-22efcf-6bccb7db6d-gwdxh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-22efcf-6bccb7db6d-gwdxh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-hjhfm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-hjhfm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-hjhfm

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d41320-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d41320-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d41320-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d41320-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba646b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba646b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

ProbeError

Readiness probe error: Get "http://10.132.1.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

Unhealthy

Readiness probe failed: Get "http://10.132.1.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9cc0e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9cc0e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

ProbeError

Startup probe error: Get "http://10.132.1.33:15021/healthz/ready": dial tcp 10.132.1.33:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

Unhealthy

Startup probe failed: Get "http://10.132.1.33:15021/healthz/ready": dial tcp 10.132.1.33:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-025c7f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-025c7f

openshift-ingress

deployment-controller

e2e-inf-a-025c7f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-025c7f-openshift-default-58f9fbc845 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-025c7f-openshift-default-58f9fbc845

SuccessfulCreate

Created pod: e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

openshift-ingress

multus

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

AddedInterface

Add eth0 [10.132.1.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-025c7f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-025c7f-f8b9959c4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-025c7f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9a93bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9a93bd

openshift-ingress

deployment-controller

e2e-inf-b-9a93bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9a93bd-openshift-default-6bbb8569cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc

SuccessfulCreate

Created pod: e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-75xkq

Started

Container started

openshift-ingress

multus

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

AddedInterface

Add eth0 [10.132.1.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-025c7f: serviceaccount "payload-processing-e2e-inf-a-025c7f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-75xkq

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-025c7f-f8b9959c4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-025c7f-f8b9959c4-s4rtf

openshift-ingress

multus

payload-processing-e2e-inf-a-025c7f-f8b9959c4-s4rtf

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-75xkq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-025c7f-f8b9959c4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-025c7f-f8b9959c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-025c7f: serviceaccount "payload-processing-e2e-inf-a-025c7f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-75xkq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-75xkq

AddedInterface

Add eth0 [10.133.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-025c7f-f8b9959c4-s4rtf

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-a-09ad1e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-09ad1e

openshift-ingress

deployment-controller

e2e-inf-a-09ad1e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-09ad1e-openshift-default-5845b78b67 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-025c7f-f8b9959c4-s4rtf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-025c7f-f8b9959c4-s4rtf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-a-09ad1e-openshift-default-5845b78b67

SuccessfulCreate

Created pod: e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

openshift-ingress

multus

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

AddedInterface

Add eth0 [10.132.1.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9a93bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9a93bd-bdbb476fd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9a93bd-bdbb476fd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9a93bd-bdbb476fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9a93bd: serviceaccount "payload-processing-e2e-inf-b-9a93bd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9a93bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9a93bd: serviceaccount "payload-processing-e2e-inf-b-9a93bd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-5k7bx

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9a93bd-bdbb476fd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9a93bd-bdbb476fd-cmm5r

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-5k7bx

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9a93bd-bdbb476fd-cmm5r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-9a93bd-bdbb476fd-cmm5r

AddedInterface

Add eth0 [10.133.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-5k7bx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-5k7bx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-5k7bx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9a93bd-bdbb476fd-cmm5r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9a93bd-bdbb476fd-cmm5r

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-09ad1e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-09ad1e-b6fbd8696 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-09ad1e-5649d5847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-09ad1e: serviceaccount "payload-processing-e2e-inf-a-09ad1e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-09ad1e-b6fbd8696

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-09ad1e-b6fbd8696-jpz2g

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-09ad1e-5649d5847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-qxxzz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-09ad1e-b6fbd8696

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-09ad1e-b6fbd8696-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-09ad1e: serviceaccount "payload-processing-e2e-inf-a-09ad1e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-09ad1e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-09ad1e-5649d5847 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-qxxzz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-09ad1e-b6fbd8696-jpz2g

AddedInterface

Add eth0 [10.133.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-qxxzz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-09ad1e-b6fbd8696-jpz2g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-09ad1e-b6fbd8696-jpz2g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-qxxzz

AddedInterface

Add eth0 [10.133.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-09ad1e-b6fbd8696-jpz2g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-qxxzz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9cc0e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9cc0e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

ProbeError

Readiness probe error: Get "http://10.132.1.36:15021/healthz/ready": read tcp 10.132.0.2:32818->10.132.1.36:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

Unhealthy

Readiness probe failed: Get "http://10.132.1.36:15021/healthz/ready": read tcp 10.132.0.2:32818->10.132.1.36:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

ProbeError

Startup probe error: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

Unhealthy

Startup probe failed: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77

SuccessfulCreate

Created pod: e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

openshift-ingress

deployment-controller

e2e-inf-b-7b7407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-7b7407-openshift-default-76bcb76d95 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-7b7407

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-7b7407

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d2a0b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-2d2a0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

AddedInterface

Add eth0 [10.134.0.248/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-7b7407-openshift-default-76bcb76d95

SuccessfulCreate

Created pod: e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

Started

Container started

openshift-ingress

multus

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

AddedInterface

Add eth0 [10.132.1.47/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

ProbeError

Startup probe error: Get "http://10.134.0.248:15021/healthz/ready": dial tcp 10.134.0.248:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

ProbeError

Readiness probe error: Get "http://10.132.1.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

Unhealthy

Startup probe failed: Get "http://10.134.0.248:15021/healthz/ready": dial tcp 10.134.0.248:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

Unhealthy

Readiness probe failed: Get "http://10.132.1.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-7b7407-c548f9455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-7b7407-c548f9455-dth8d

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-7b7407-8575d85884

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-7b7407-8575d85884-72pjq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-7b7407

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-7b7407-c548f9455 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-7b7407-8575d85884

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-7b7407-8575d85884-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-7b7407: serviceaccount "payload-processing-e2e-inf-b-7b7407" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-7b7407

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-7b7407-8575d85884 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-7b7407-c548f9455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-7b7407-c548f9455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-7b7407: serviceaccount "payload-processing-e2e-inf-b-7b7407" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-7b7407-c548f9455-dth8d

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7b7407-8575d85884-72pjq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-7b7407-8575d85884-72pjq

AddedInterface

Add eth0 [10.134.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7b7407-8575d85884-72pjq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7b7407-8575d85884-72pjq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7b7407-c548f9455-dth8d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7b7407-c548f9455-dth8d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7b7407-c548f9455-dth8d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

ProbeError

Startup probe error: Get "http://10.132.1.35:15021/healthz/ready": dial tcp 10.132.1.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

Unhealthy

Startup probe failed: Get "http://10.132.1.35:15021/healthz/ready": dial tcp 10.132.1.35:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-22efcf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-22efcf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba646b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba646b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-22efcf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-22efcf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

ProbeError

Readiness probe error: Get "http://10.132.1.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

Unhealthy

Readiness probe failed: Get "http://10.132.1.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-inf-b-ba646b-openshift-default-5b5998b9ff

SuccessfulCreate

Created pod: e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba646b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-ba646b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ba646b-openshift-default-5b5998b9ff from 1 to 2

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

ProbeError

Readiness probe error: Get "http://10.132.1.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll

AddedInterface

Add eth0 [10.134.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

Unhealthy

Readiness probe failed: Get "http://10.132.1.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-b-f97234

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f97234

openshift-ingress

deployment-controller

e2e-inf-b-f97234-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f97234-openshift-default-f5dd5c7d7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-f97234-openshift-default-f5dd5c7d7

SuccessfulCreate

Created pod: e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

openshift-ingress

multus

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

AddedInterface

Add eth0 [10.132.1.49/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll

Unhealthy

Startup probe failed: Get "http://10.134.0.253:15021/healthz/ready": dial tcp 10.134.0.253:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll

ProbeError

Startup probe error: Get "http://10.134.0.253:15021/healthz/ready": dial tcp 10.134.0.253:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

Unhealthy

Startup probe failed: Get "http://10.132.1.44:15021/healthz/ready": dial tcp 10.132.1.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

ProbeError

Startup probe error: Get "http://10.132.1.44:15021/healthz/ready": dial tcp 10.132.1.44:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

Unhealthy

Startup probe failed: Get "http://10.132.1.46:15021/healthz/ready": dial tcp 10.132.1.46:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

ProbeError

Startup probe error: Get "http://10.132.1.46:15021/healthz/ready": dial tcp 10.132.1.46:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-09ad1e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-09ad1e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-f97234

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-f97234-69b66665f6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f97234-c597c8447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-f97234-c597c8447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f97234: serviceaccount "payload-processing-e2e-inf-b-f97234" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f97234-c597c8447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-f97234-c597c8447-q8xqp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-f97234

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-f97234-c597c8447 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f97234-69b66665f6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-f97234-69b66665f6-78mks
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f97234-69b66665f6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-f97234-69b66665f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f97234: serviceaccount "payload-processing-e2e-inf-b-f97234" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-f97234-c597c8447-q8xqp

AddedInterface

Add eth0 [10.133.0.234/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-f97234-69b66665f6-78mks

AddedInterface

Add eth0 [10.133.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f97234-c597c8447-q8xqp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f97234-c597c8447-q8xqp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f97234-c597c8447-q8xqp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f97234-69b66665f6-78mks

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f97234-69b66665f6-78mks

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f97234-69b66665f6-78mks

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-025c7f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-inf-b-af8369-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-af8369-openshift-default-6559ddb96c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-af8369-openshift-default-6559ddb96c

SuccessfulCreate

Created pod: e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

openshift-ingress

gateway_labeler_controller

e2e-inf-b-af8369

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-af8369
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-025c7f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

AddedInterface

Add eth0 [10.132.1.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-9a93bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9a93bd-openshift-default-6bbb8569cc from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9a93bd-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc

SuccessfulCreate

Created pod: e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc

openshift-ingress

replicaset-controller

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc

SuccessfulCreate

Created pod: e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc

Created

Container created

openshift-ingress

multus

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

AddedInterface

Add eth0 [10.133.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

Started

Container started

openshift-ingress

multus

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc

AddedInterface

Add eth0 [10.134.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-af8369

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-af8369-746d5899b8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-af8369-746d5899b8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-af8369-746d5899b8-zg9t9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-af8369-6b99d499cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-af8369: serviceaccount "payload-processing-e2e-inf-b-af8369" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-af8369-746d5899b8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-af8369-746d5899b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-af8369: serviceaccount "payload-processing-e2e-inf-b-af8369" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-af8369

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-af8369-6b99d499cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-af8369-6b99d499cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-r6vw8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-09ad1e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-r6vw8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-af8369-746d5899b8-zg9t9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-af8369-746d5899b8-zg9t9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-r6vw8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-af8369-746d5899b8-zg9t9

AddedInterface

Add eth0 [10.133.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-af8369-746d5899b8-zg9t9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-r6vw8

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-09ad1e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-r6vw8

AddedInterface

Add eth0 [10.133.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

Unhealthy

Readiness probe failed: Get "http://10.132.1.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

ProbeError

Readiness probe error: Get "http://10.132.1.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

Unhealthy

Readiness probe failed: Get "http://10.132.1.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

ProbeError

Readiness probe error: Get "http://10.132.1.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc

Unhealthy

Startup probe failed: Get "http://10.134.0.254:15021/healthz/ready": dial tcp 10.134.0.254:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc

ProbeError

Startup probe error: Get "http://10.134.0.254:15021/healthz/ready": dial tcp 10.134.0.254:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

ProbeError

Startup probe error: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

Unhealthy

Startup probe failed: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-025c7f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-025c7f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9a93bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9a93bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

ProbeError

Startup probe error: Get "http://10.132.1.47:15021/healthz/ready": dial tcp 10.132.1.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

Unhealthy

Startup probe failed: Get "http://10.132.1.47:15021/healthz/ready": dial tcp 10.132.1.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

ProbeError

Startup probe error: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-7b7407-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

Unhealthy

Startup probe failed: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-7b7407-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9a93bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9a93bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-7b7407-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-7b7407-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-k879q

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 10 to 9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-k879q

openshift-ingress

kubelet

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

ProbeError

Readiness probe error: Get "http://10.132.1.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

Unhealthy

Readiness probe failed: Get "http://10.132.1.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

Unhealthy

Readiness probe failed: Get "http://10.132.1.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

ProbeError

Readiness probe error: Get "http://10.132.1.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-7b7407-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-7b7407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-7b7407-openshift-default-76bcb76d95 from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-b-7b7407-openshift-default-76bcb76d95

SuccessfulCreate

Created pod: e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

openshift-ingress

multus

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

AddedInterface

Add eth0 [10.133.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

Unhealthy

Startup probe failed: Get "http://10.133.0.243:15021/healthz/ready": dial tcp 10.133.0.243:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

ProbeError

Startup probe error: Get "http://10.133.0.243:15021/healthz/ready": dial tcp 10.133.0.243:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

Created

Container created

openshift-ingress

multus

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

AddedInterface

Add eth0 [10.133.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f97234-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

Started

Container started

openshift-ingress

deployment-controller

e2e-inf-b-f97234-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f97234-openshift-default-f5dd5c7d7 from 1 to 4

openshift-ingress

multus

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

AddedInterface

Add eth0 [10.134.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-b-f97234-openshift-default-f5dd5c7d7

SuccessfulCreate

Created pod: e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7

openshift-ingress

replicaset-controller

e2e-inf-b-f97234-openshift-default-f5dd5c7d7

SuccessfulCreate

Created pod: e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

openshift-ingress

replicaset-controller

e2e-inf-b-f97234-openshift-default-f5dd5c7d7

SuccessfulCreate

Created pod: e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

Started

Container started

openshift-ingress

multus

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7

AddedInterface

Add eth0 [10.132.1.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

Unhealthy

Startup probe failed: Get "http://10.132.1.50:15021/healthz/ready": dial tcp 10.132.1.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

ProbeError

Startup probe error: Get "http://10.132.1.50:15021/healthz/ready": dial tcp 10.132.1.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

ProbeError

Startup probe error: Get "http://10.134.1.0:15021/healthz/ready": dial tcp 10.134.1.0:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

Unhealthy

Startup probe failed: Get "http://10.134.1.0:15021/healthz/ready": dial tcp 10.134.1.0:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

ProbeError

Startup probe error: Get "http://10.133.0.244:15021/healthz/ready": dial tcp 10.133.0.244:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

Unhealthy

Startup probe failed: Get "http://10.133.0.244:15021/healthz/ready": dial tcp 10.133.0.244:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7

Unhealthy

Startup probe failed: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7

ProbeError

Startup probe error: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

ProbeError

Startup probe error: Get "http://10.132.1.49:15021/healthz/ready": dial tcp 10.132.1.49:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

Unhealthy

Startup probe failed: Get "http://10.132.1.49:15021/healthz/ready": dial tcp 10.132.1.49:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-af8369-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-af8369-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f97234-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f97234-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-b-f97234-openshift-default-f5dd5c7d7

SuccessfulCreate

Created pod: e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

openshift-ingress

multus

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5

AddedInterface

Add eth0 [10.133.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-b-f97234-openshift-default-f5dd5c7d7

SuccessfulCreate

Created pod: e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5

openshift-ingress

multus

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f97234-openshift-default

SuccessfulRescale

New size: 6; reason:

openshift-ingress

deployment-controller

e2e-inf-b-f97234-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f97234-openshift-default-f5dd5c7d7 from 4 to 6

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5

Unhealthy

Startup probe failed: Get "http://10.133.0.245:15021/healthz/ready": dial tcp 10.133.0.245:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5

ProbeError

Startup probe error: Get "http://10.133.0.245:15021/healthz/ready": dial tcp 10.133.0.245:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

Unhealthy

Startup probe failed: Get "http://10.134.1.2:15021/healthz/ready": dial tcp 10.134.1.2:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

ProbeError

Startup probe error: Get "http://10.134.1.2:15021/healthz/ready": dial tcp 10.134.1.2:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-af8369-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-af8369-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc

SuccessfulDelete

Deleted pod: e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

openshift-ingress

deployment-controller

e2e-worker-w0-7a8b03-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-7a8b03-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-dwzh9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-7jlq7

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 9 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7jlq7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-63499e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-63499e-openshift-default-6df6b584fc from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-63499e-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-63499e-openshift-default-6df6b584fc

SuccessfulDelete

Deleted pod: e2e-extmod-a-63499e-openshift-default-6df6b584fc-xbqc4

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-gq9mb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-75d385-openshift-default-8785c777c

SuccessfulDelete

Deleted pod: e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

openshift-ingress

deployment-controller

e2e-extmod-b-75d385-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-75d385-openshift-default-8785c777c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-75d385-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-zt757

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0d9115-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-0d9115-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-0d9115-openshift-default-856bf8bb69 from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-0d9115-openshift-default-856bf8bb69

SuccessfulDelete

Deleted pod: e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-kfk8w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-28wtn

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-28wtn

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 8 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-jhgnx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-jhgnx

openshift-ingress

replicaset-controller

e2e-inf-a-09ad1e-openshift-default-5845b78b67

SuccessfulCreate

Created pod: e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-09ad1e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-09ad1e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-09ad1e-openshift-default-5845b78b67 from 1 to 2

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h

AddedInterface

Add eth0 [10.133.0.246/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h

Unhealthy

Startup probe failed: Get "http://10.133.0.246:15021/healthz/ready": dial tcp 10.133.0.246:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h

ProbeError

Startup probe error: Get "http://10.133.0.246:15021/healthz/ready": dial tcp 10.133.0.246:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-pz64d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d41320-6fbcbd98fb-8kmvg

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77

SuccessfulDelete

Deleted pod: e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-ndnpr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d2a0b-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-2d2a0b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77 from 2 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-22efcf-openshift-default-778dff5c67

SuccessfulCreate

Created pod: e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-22efcf-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-22efcf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-22efcf-openshift-default-778dff5c67 from 1 to 2

openshift-ingress

multus

e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59

AddedInterface

Add eth0 [10.133.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59

Unhealthy

Startup probe failed: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59

ProbeError

Startup probe error: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d41320-6fbcbd98fb-8kmvg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d41320-687fb8bd99-pz64d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-d41320-openshift-default-9c8899ff9-hk9sq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-vx7jm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ba646b-597b979dd4-4fxpc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba646b-787f7ddf4c-vx7jm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ba646b-597b979dd4-4fxpc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-worker-w2-bb86fd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-bb86fd-openshift-default-67498875d9 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-bb86fd-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-bb86fd-openshift-default-67498875d9

SuccessfulDelete

Deleted pod: e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-6jgv6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-025c7f-openshift-default-58f9fbc845

SuccessfulCreate

Created pod: e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-025c7f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-025c7f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-025c7f-openshift-default-58f9fbc845 from 1 to 2

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

AddedInterface

Add eth0 [10.134.1.3/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

ProbeError

Startup probe error: Get "http://10.134.1.3:15021/healthz/ready": dial tcp 10.134.1.3:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

Unhealthy

Startup probe failed: Get "http://10.134.1.3:15021/healthz/ready": dial tcp 10.134.1.3:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9

SuccessfulDelete

Deleted pod: e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-6ff0e6-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-9tjsp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-6ff0e6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9 from 2 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-77b6j

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-p95xn

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-p95xn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 6 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-77b6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-e652ca-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-e652ca-openshift-default-7b8fb7f765 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e652ca-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765

SuccessfulDelete

Deleted pod: e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-gs4kx

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-qqbsz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-ba646b-openshift-default-5b5998b9ff-4hfll

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc

SuccessfulDelete

Deleted pod: e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-hmhgj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-9a93bd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-inf-b-9a93bd-openshift-default-6bbb8569cc from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9a93bd-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-57f78bcd55 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-ljfbp

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-7hbnd

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-f8kbm
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-57f78bcd55-vkjph

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7hbnd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-7hbnd

AddedInterface

Add eth0 [10.133.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-vkjph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-f8kbm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-f8kbm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-f8kbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-ljfbp

AddedInterface

Add eth0 [10.134.1.5/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-ljfbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-f8kbm

AddedInterface

Add eth0 [10.132.1.65/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-vkjph

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-vkjph

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-ljfbp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-ljfbp

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-vkjph

AddedInterface

Add eth0 [10.134.1.4/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7hbnd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7hbnd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-hjhfm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-22efcf-6bccb7db6d-gwdxh

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-ljfbp

Unhealthy

Startup probe failed: Get "http://10.134.1.5:15021/healthz/ready": dial tcp 10.134.1.5:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-ljfbp

ProbeError

Startup probe error: Get "http://10.134.1.5:15021/healthz/ready": dial tcp 10.134.1.5:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-f8kbm

Unhealthy

Startup probe failed: Get "http://10.132.1.65:15021/healthz/ready": dial tcp 10.132.1.65:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-vkjph

Unhealthy

Startup probe failed: Get "http://10.134.1.4:15021/healthz/ready": dial tcp 10.134.1.4:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-vkjph

ProbeError

Startup probe error: Get "http://10.134.1.4:15021/healthz/ready": dial tcp 10.134.1.4:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7hbnd

ProbeError

Startup probe error: Get "http://10.133.0.248:15021/healthz/ready": dial tcp 10.133.0.248:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7hbnd

Unhealthy

Startup probe failed: Get "http://10.133.0.248:15021/healthz/ready": dial tcp 10.133.0.248:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-f8kbm

ProbeError

Startup probe error: Get "http://10.132.1.65:15021/healthz/ready": dial tcp 10.132.1.65:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-57f78bcd55 from 8 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-xpssg

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-xpssg

AddedInterface

Add eth0 [10.133.0.249/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-57f78bcd55-rfmxm

AddedInterface

Add eth0 [10.132.1.68/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-xpssg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-xpssg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rfmxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rfmxm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rfmxm

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-22efcf-5cb4946c79-hjhfm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-xpssg

ProbeError

Startup probe error: Get "http://10.133.0.249:15021/healthz/ready": dial tcp 10.133.0.249:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-xpssg

Unhealthy

Startup probe failed: Get "http://10.133.0.249:15021/healthz/ready": dial tcp 10.133.0.249:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9cc0e6-6557cfd444-9ltnx

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rfmxm

ProbeError

Startup probe error: Get "http://10.132.1.68:15021/healthz/ready": dial tcp 10.132.1.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-qpthf

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rfmxm

Unhealthy

Startup probe failed: Get "http://10.132.1.68:15021/healthz/ready": dial tcp 10.132.1.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-f97234-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-inf-b-f97234-openshift-default-f5dd5c7d7 from 6 to 4

openshift-ingress

replicaset-controller

e2e-inf-b-f97234-openshift-default-f5dd5c7d7

SuccessfulDelete

Deleted pod: e2e-inf-b-f97234-openshift-default-f5dd5c7d7-v76vt

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f97234-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-f97234-openshift-default-f5dd5c7d7

SuccessfulDelete

Deleted pod: e2e-inf-b-f97234-openshift-default-f5dd5c7d7-cvrs5
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9cc0e6-6557cfd444-9ltnx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9cc0e6-55b9b7cf59-qpthf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-zsb59

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-22efcf-openshift-default-778dff5c67-7nxzz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-75xkq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-025c7f-f8b9959c4-s4rtf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-09ad1e-b6fbd8696-jpz2g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-qxxzz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7b7407-c548f9455-dth8d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7b7407-8575d85884-72pjq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-025c7f-59d495bd6c-75xkq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-9cc0e6-openshift-default-5459db5bff-gmgvx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-hwqxr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-025c7f-openshift-default-58f9fbc845-k9n4b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-09ad1e-b6fbd8696-jpz2g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-09ad1e-5649d5847-qxxzz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7b7407-c548f9455-dth8d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-5k7bx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9a93bd-bdbb476fd-cmm5r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f97234-69b66665f6-78mks

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f97234-c597c8447-q8xqp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-jg55h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-09ad1e-openshift-default-5845b78b67-glgv6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-af8369-746d5899b8-zg9t9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-r6vw8

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f97234-c597c8447-q8xqp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9a93bd-767f7c6dbc-5k7bx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9a93bd-bdbb476fd-cmm5r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-l49nz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-7b7407-openshift-default-76bcb76d95-8dxfs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-af8369-6b99d499cf-r6vw8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-kjmtc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-t6kd7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-ql2fc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-d01cd5a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d01cd5a5-openshift-default-df545ffd9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-d01cd5a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d01cd5a5

openshift-ingress

replicaset-controller

e2e-mt-d01cd5a5-openshift-default-df545ffd9

SuccessfulCreate

Created pod: e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh

openshift-ingress

multus

e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh

AddedInterface

Add eth0 [10.132.1.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

Unhealthy

Readiness probe failed: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-9a93bd-openshift-default-6bbb8569cc-2vj2n

ProbeError

Readiness probe error: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-452bg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-f97234-openshift-default-f5dd5c7d7-7bfvm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d01cd5a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d01cd5a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d01cd5a5-8c5795c58 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d01cd5a5-8c5795c58

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d01cd5a5-8c5795c58-cgmdg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d01cd5a5: serviceaccount "payload-processing-e2e-mt-d01cd5a5" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d01cd5a5-8c5795c58

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d01cd5a5-8c5795c58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d01cd5a5: serviceaccount "payload-processing-e2e-mt-d01cd5a5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7-wp4tp

openshift-ingress

multus

payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7-wp4tp

AddedInterface

Add eth0 [10.132.1.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7-wp4tp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-d01cd5a5-8c5795c58-cgmdg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-d01cd5a5-8c5795c58-cgmdg

AddedInterface

Add eth0 [10.133.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7-wp4tp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-d01cd5a5-8c5795c58-cgmdg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-d01cd5a5-8c5795c58-cgmdg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7-wp4tp

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-af8369-openshift-default-6559ddb96c-pc9m8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh

ProbeError

Startup probe error: Get "http://10.132.1.100:15021/healthz/ready": dial tcp 10.132.1.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh

Unhealthy

Startup probe failed: Get "http://10.132.1.100:15021/healthz/ready": dial tcp 10.132.1.100:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d01cd5a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d01cd5a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0505b0-7d58478d-dqfnx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-ddsdz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0505b0-db6f69cc9-ddsdz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0505b0-7d58478d-dqfnx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-0505b0-openshift-default-d499f445-ks6mb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d01cd5a5-8fcbbf4d7-wp4tp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d01cd5a5-8c5795c58-cgmdg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-9jmmc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-6ts5w

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0d9115-dcd4c5b5f-9jmmc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0d9115-f5cb4bd8b-6ts5w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-mt-d01cd5a5-openshift-default-df545ffd9-f8mrh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-0d9115-openshift-default-856bf8bb69-tv89c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-t7bcj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-rn6ng

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-bd2aaf-55bb97fcf4-t7bcj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-bd2aaf-599d6f54dc-rn6ng

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-bd2aaf-openshift-default-849cb87f69-w524z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-g5ppw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-tcp75

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-j7qpr

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j7qpr

Killing

Stopping container discovery
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-71fbeb-7d77b5574-tcp75

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-71fbeb-d4dfbc4ff-g5ppw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-71fbeb-openshift-default-688f4d9669-7f6lv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-x5455

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-bb529

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-667ht

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-slg62

Killing

Stopping container payload-processing

opendatahub

kubelet

test-curl-11532-5e1c6e

Created

Container created

opendatahub

multus

test-curl-11532-5e1c6e

AddedInterface

Add eth0 [10.134.1.14/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11532-5e1c6e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11532-5e1c6e

Started

Container started

opendatahub

kubelet

test-curl-11532-b7e03c

Started

Container started

opendatahub

kubelet

test-curl-11532-b7e03c

Created

Container created

opendatahub

kubelet

test-curl-11532-b7e03c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11532-b7e03c

AddedInterface

Add eth0 [10.134.1.15/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11532-5e1c6e

Killing

Stopping container test-curl-11532-5e1c6e

opendatahub

kubelet

test-curl-11532-b7e03c

Killing

Stopping container test-curl-11532-b7e03c
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-6ff0e6-5c9957ff46-bb529

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-6ff0e6-696f566c6c-x5455

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-shared-a-w2-e9cb4a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c from 1 to 2

openshift-ingress

multus

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt

AddedInterface

Add eth0 [10.134.1.16/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c

SuccessfulCreate

Created pod: e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-e9cb4a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt

Started

Container started
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-acf9e2-56f8ddccf5-667ht

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-acf9e2-5f6c7f76b4-slg62

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt

ProbeError

Startup probe error: Get "http://10.134.1.16:15021/healthz/ready": dial tcp 10.134.1.16:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt

Unhealthy

Startup probe failed: Get "http://10.134.1.16:15021/healthz/ready": dial tcp 10.134.1.16:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-acf9e2-openshift-default-5f97bd99d9-jfhbd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-bg4xq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-c4w2w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-6ff0e6-openshift-default-69954f5dd9-w26r2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-c2llr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-63499e-5dd54b859b-c22tf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-88e9f3-6f4f779dbd-c4w2w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-88e9f3-76786c4475-bg4xq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-88e9f3-openshift-default-68c959b4cc-xbxng

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-63499e-openshift-default-6df6b584fc-dnjrw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-63499e-5dd54b859b-c22tf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-63499e-85956dd9bc-c2llr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-h2shk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-czsrx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8740d4-59db5fb696-7b579

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-szvh5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-rfmxm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-f8kbm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 10 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-57f78bcd55

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-57f78bcd55-f8kbm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-rfmxm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-m5qkl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1957dc-6774bd598b-xb4k4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8740d4-59db5fb696-7b579

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8740d4-675f87d779-szvh5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-xpssg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-vkjph

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-57f78bcd55-7hbnd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-57f78bcd55 from 8 to 5
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7a8b38-8b9d9c555-h2shk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7a8b38-66dd77cbb-czsrx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-8740d4-openshift-default-79ccb5884f-cllf2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1957dc-6774bd598b-xb4k4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1957dc-559d4d7687-m5qkl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-7a8b38-openshift-default-6b889d6d97-zxpfh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1957dc-openshift-default-7d8748ffcc-bg9m2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-vvrg6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-xxh4w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-87vkq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-s7l69

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-wlpck

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-7w5vb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d2a0b-55c8d7f867-wlpck

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-98dabb-openshift-default-778885789c-62pl6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d2a0b-67f88c66b4-7w5vb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e9cb4a-64dff45dc6-vvrg6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e9cb4a-68c7dd7ff-xxh4w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-98dabb-67d7c4fcd-87vkq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-98dabb-bb4fcbb5f-s7l69

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-2d2a0b-openshift-default-79dff8cb77-xczk7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-4dwgt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-9dg75

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4db150-679bfc745b-h5cx5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-e9cb4a-openshift-default-77c74c484c-ptxrf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e652ca-7f8745bddb-kcxfc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-h9q7m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-xjn52

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-grmdx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-nmcmp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-517a25-67d96956bb-p7jgq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-4db150-openshift-default-75fddffd6f-c4pkz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4db150-5f6d995d79-9dg75

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4db150-679bfc745b-h5cx5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e652ca-68d7c9b8f9-h9q7m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-75d385-67669b7955-t2gd5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-fbfm8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e652ca-7f8745bddb-kcxfc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-92855c-openshift-default-7f5cd54b5c-kcrcd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-517a25-openshift-default-66996c9485-55wzn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-92855c-5cf7c45c4b-xjn52

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-92855c-7ff68878c-grmdx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-517a25-67d96956bb-p7jgq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-517a25-fcdcc76d7-nmcmp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-4kzgq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-vd9hg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-rv2p4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-hlbp6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-e652ca-openshift-default-7b8fb7f765-kpzxj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-75d385-67669b7955-t2gd5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-75d385-5d5cdd6f58-fbfm8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-75d385-openshift-default-8785c777c-q97fp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-241ffa-8ffc69466-rv2p4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-xppfw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-vqj2x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-bb86fd-openshift-default-67498875d9-q5t8x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-bb86fd-fb85fbf4b-vd9hg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-bb86fd-6b8dcfc5f9-4kzgq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-241ffa-openshift-default-79cfbc884f-q98l2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-241ffa-78b5645f79-hlbp6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-f49b40-openshift-default-54759894c5-n6bth

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7a8b03-67b9cbb595-6krft

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7a8b03-84f9f89544-dsz5l

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f49b40-7bcf54d65b-vqj2x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f49b40-565d6f5f87-xppfw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-qd57l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-jpx5x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-451a21-openshift-default-c48d9fc87-spvw4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-7a8b03-openshift-default-85fbd85cdc-tw62d

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-451a21-d9dd5f59f-qd57l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-451a21-7f55f6f596-jpx5x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-551dd1-5c7d8d7f44-2jnp5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-551dd1-7c4f8b8f55-swrq2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-551dd1-openshift-default-8479fbc77f-lb7xs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503