Time Namespace Component RelatedObject Reason Message

openshift-ingress

router-default-75fdfd5b99-vpjd7

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd to ip-10-0-136-103.ec2.internal

openshift-ingress

e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv to ip-10-0-130-102.ec2.internal

openshift-ingress

e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm to ip-10-0-136-105.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5 to ip-10-0-136-105.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-skcpz

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-skcpz to ip-10-0-136-103.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-dtzmt

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-dtzmt to ip-10-0-136-103.ec2.internal

openshift-ingress

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q to ip-10-0-136-105.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-wq5qd

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-wq5qd to ip-10-0-130-102.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-xwz9c

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-xwz9c to ip-10-0-130-102.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6cbccd5bdc-h244v to ip-10-0-136-103.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-fr7x6

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-fr7x6 to ip-10-0-136-105.ec2.internal

openshift-ingress

e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt to ip-10-0-136-103.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-qtdgm

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-qtdgm to ip-10-0-136-103.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6cbccd5bdc-gb874 to ip-10-0-130-102.ec2.internal

openshift-ingress

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn to ip-10-0-136-103.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-rhkgh

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-rhkgh to ip-10-0-136-105.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-rxctj

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-rxctj to ip-10-0-136-103.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-nw46b

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-nw46b to ip-10-0-136-103.ec2.internal

opendatahub

odh-model-controller-769875db56-ncjwb

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-ncjwb to ip-10-0-136-105.ec2.internal

openshift-ingress

e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc to ip-10-0-130-102.ec2.internal

openshift-ingress

kube-auth-proxy-869444d94f-84r4k

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-869444d94f-84r4k to ip-10-0-136-103.ec2.internal

openshift-ingress

kube-auth-proxy-869444d94f-mkwbn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-869444d94f-mkwbn to ip-10-0-136-105.ec2.internal

openshift-ingress

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t to ip-10-0-136-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-2bv6f

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-2bv6f to ip-10-0-136-105.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8r7qx4

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8r7qx4 to ip-10-0-136-103.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-g98cv

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-g98cv to ip-10-0-136-103.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-xvbrz

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-xvbrz to ip-10-0-136-103.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-jfhw9

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-jfhw9 to ip-10-0-136-105.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-xdsnd

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-xdsnd to ip-10-0-130-102.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-5fpf4

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-5fpf4 to ip-10-0-130-102.ec2.internal

openshift-ingress

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf to ip-10-0-136-103.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-6njrd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6njrd to ip-10-0-130-102.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-cvhp5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cvhp5 to ip-10-0-130-102.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-q9ng9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-q9ng9 to ip-10-0-136-103.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-qnfsg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-qnfsg to ip-10-0-136-103.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-qqbk5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-qqbk5 to ip-10-0-130-102.ec2.internal

kuadrant-system

authorino-5774ffdd7b-lhvxf

Scheduled

Successfully assigned kuadrant-system/authorino-5774ffdd7b-lhvxf to ip-10-0-136-105.ec2.internal

cert-manager

cert-manager-597b95cb84-nkx9x

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-nkx9x to ip-10-0-130-102.ec2.internal

openshift-ingress

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph to ip-10-0-130-102.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-tqkjg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-tqkjg to ip-10-0-136-103.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-tvj2n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-tvj2n to ip-10-0-136-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-tzpc7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-tzpc7 to ip-10-0-130-102.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6dcf757899-wltdx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wltdx to ip-10-0-136-105.ec2.internal

kuadrant-system

authorino-57f7f8659f-ljl9r

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-ljl9r to ip-10-0-136-105.ec2.internal

models-as-a-service

payload-processing-external-model-58db6964f9-4h2sp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-58db6964f9-4h2sp to ip-10-0-136-103.ec2.internal

models-as-a-service

payload-processing-external-model-5d7cd86ff8-98ffs

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5d7cd86ff8-98ffs to ip-10-0-136-103.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-jzhdq

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-jzhdq to ip-10-0-136-105.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-58fd47455f-h92rd

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-h92rd to ip-10-0-130-102.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-mfkvl

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-mfkvl to ip-10-0-136-105.ec2.internal

models-as-a-service

payload-processing-external-model-77cdcd47c-pbnr9

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-77cdcd47c-pbnr9 to ip-10-0-136-103.ec2.internal

models-as-a-service

payload-processing-external-model-d66597b7c-bc8tq

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d66597b7c-bc8tq to ip-10-0-130-102.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-jffqg

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-jffqg to ip-10-0-130-102.ec2.internal

kuadrant-system

authorino-6889cbd8c4-9dh4s

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-9dh4s to ip-10-0-136-105.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7d699c9f7chc8s4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7chc8s4 to ip-10-0-130-102.ec2.internal

openshift-jobset-operator

jobset-controller-manager-585f46ff54-gstjh

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-585f46ff54-gstjh to ip-10-0-130-102.ec2.internal

openshift-ingress

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59 to ip-10-0-130-102.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-rp492

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-rp492 to ip-10-0-136-103.ec2.internal

openshift-ingress

e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9 to ip-10-0-130-102.ec2.internal

opendatahub

maas-controller-5c5b87b589-7fw2t

Scheduled

Successfully assigned opendatahub/maas-controller-5c5b87b589-7fw2t to ip-10-0-136-103.ec2.internal

opendatahub

maas-controller-56d4bb9f9f-9pwh4

Scheduled

Successfully assigned opendatahub/maas-controller-56d4bb9f9f-9pwh4 to ip-10-0-136-105.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-dp2zp

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-dp2zp to ip-10-0-136-105.ec2.internal

kuadrant-system

authorino-6f6944bcdd-zsnt2

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-zsnt2 to ip-10-0-136-105.ec2.internal

openshift-ingress

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g to ip-10-0-136-105.ec2.internal

models-as-a-service

payload-processing-external-model-d66597b7c-z44ct

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d66597b7c-z44ct to ip-10-0-136-103.ec2.internal

kuadrant-system

authorino-f7f688f59-lvj75

Scheduled

Successfully assigned kuadrant-system/authorino-f7f688f59-lvj75 to ip-10-0-136-105.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-n2ljx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-n2ljx to ip-10-0-136-103.ec2.internal

openshift-ingress

e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq

Scheduled

Successfully assigned openshift-ingress/e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq to ip-10-0-136-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-48afdd9e-6b954754c-sx2qk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-48afdd9e-6b954754c-sx2qk to ip-10-0-136-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-m9k6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-m9k6p to ip-10-0-136-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f7d8050f-85c496447-vzmqt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f7d8050f-85c496447-vzmqt to ip-10-0-136-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-a33e5151-6655fc458c-lkp5p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-a33e5151-6655fc458c-lkp5p to ip-10-0-136-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5-q7tvf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5-q7tvf to ip-10-0-136-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-x7ncz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-x7ncz to ip-10-0-136-105.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-trgmc

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-trgmc to ip-10-0-130-102.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-mqlhg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-mqlhg to ip-10-0-136-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-v5scm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-v5scm to ip-10-0-136-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-rtlmq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-rtlmq to ip-10-0-136-105.ec2.internal

openshift-ingress

e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g to ip-10-0-130-102.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-a47385-7495675595-cqb8h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-a47385-7495675595-cqb8h to ip-10-0-136-105.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-b8qh5

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-b8qh5 to ip-10-0-136-103.ec2.internal

openshift-ingress

payload-processing-e2e-ait-48afdd9e-7d9796f4dd-s76rr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-48afdd9e-7d9796f4dd-s76rr to ip-10-0-136-103.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ed302a08-847f99dd5b-79tbt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ed302a08-847f99dd5b-79tbt to ip-10-0-136-105.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f7d8050f-9477df678-26mhs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f7d8050f-9477df678-26mhs to ip-10-0-136-103.ec2.internal

openshift-ingress

payload-processing-e2e-derive-a33e5151-85fc5ccf7b-nzgfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-a33e5151-85fc5ccf7b-nzgfr to ip-10-0-136-105.ec2.internal

openshift-ingress

e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t to ip-10-0-130-102.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-b77c9bba-b86bff66-9psmc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-b77c9bba-b86bff66-9psmc to ip-10-0-136-103.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-f6f7d5-97c74567d-m5qpf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-f6f7d5-97c74567d-m5qpf to ip-10-0-136-105.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-rcpbt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-rcpbt to ip-10-0-136-105.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-b2ef42-79fb677864-pscfj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-b2ef42-79fb677864-pscfj to ip-10-0-136-105.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4 to ip-10-0-130-102.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-a47385-5f469786c4-qwf5c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-a47385-5f469786c4-qwf5c to ip-10-0-136-105.ec2.internal

openshift-ingress

router-default-75fdfd5b99-vpjd7

FailedScheduling

no nodes available to schedule pods

kuadrant-system

limitador-limitador-74dfcfb894-6b2gq

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-6b2gq to ip-10-0-130-102.ec2.internal

openshift-ingress

router-default-75fdfd5b99-vpjd7

Scheduled

Successfully assigned openshift-ingress/router-default-75fdfd5b99-vpjd7 to ip-10-0-130-102.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-pnb5q

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-pnb5q to ip-10-0-136-105.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-cns7p

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-cns7p to ip-10-0-130-102.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-l8dsg

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-l8dsg to ip-10-0-136-105.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-bk986

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-bk986 to ip-10-0-130-102.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-s47vd

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-s47vd to ip-10-0-136-105.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-qd9ff

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-qd9ff to ip-10-0-136-103.ec2.internal

opendatahub

ai-gateway-controller-7b4cb8955-jcvnm

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7b4cb8955-jcvnm to ip-10-0-136-103.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-75fdfd5b99 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

router-default-75fdfd5b99

SuccessfulCreate

Created pod: router-default-75fdfd5b99-vpjd7

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-75fdfd5b99-vpjd7

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-75fdfd5b99-vpjd7

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x2)

openshift-ingress

kubelet

router-default-75fdfd5b99-vpjd7

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-75fdfd5b99-vpjd7

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-75fdfd5b99-vpjd7

Started

Container started

openshift-ingress

multus

router-default-75fdfd5b99-vpjd7

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-75fdfd5b99-vpjd7

Created

Container created

openshift-ingress

kubelet

router-default-75fdfd5b99-vpjd7

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-skcpz

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-skcpz

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-skcpz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-skcpz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.45s (3.45s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-skcpz

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-skcpz

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-skcpz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-skcpz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-58fd47455f

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-58fd47455f-h92rd

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-58fd47455f-h92rd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-58fd47455f from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-2bv6f

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-2bv6f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6dcf757899-2bv6f

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 0 to 1

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-58fd47455f-h92rd

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-58fd47455f-h92rd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.505s (2.505s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-58fd47455f-h92rd

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-58fd47455f-h92rd

Started

Container started

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-2bv6f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.041s (7.041s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-mfkvl

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-mfkvl

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mfkvl

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mfkvl

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mfkvl

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 1.799s (1.799s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mfkvl

Created

Container created
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-mfkvl_06936ff6-e21f-462a-a48f-b45d7b80964c became leader
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6cbccd5bdc

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6cbccd5bdc-h244v

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6cbccd5bdc

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6cbccd5bdc

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6cbccd5bdc-gb874

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-6cbccd5bdc from 0 to 3

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.81s (2.81s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.926s (2.926s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.818s (2.818s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 295ms (295ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 327ms (327ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-gb874

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-h244v

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

Started

Container started

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-bk986

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 392ms (392ms including waiting). Image size: 273709574 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6cbccd5bdc-mcwz5

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-6cbccd5bdc-gb874_09ab1e2c-a99b-40ef-aff1-e0cb48707f20

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-6cbccd5bdc-gb874_09ab1e2c-a99b-40ef-aff1-e0cb48707f20 became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-bk986

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-bk986

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-pv9cz

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-bk986

Started

Container started

kuadrant-system

dns-operator-controller-manager-8557cbdb84-bk986_9dffc39e-8818-4901-b184-3dac545898dd

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-bk986_9dffc39e-8818-4901-b184-3dac545898dd became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-bk986

Created

Container created

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-xwz9c
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-bk986

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.793s (2.793s including waiting). Image size: 190804149 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-xwz9c

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-xwz9c

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-xwz9c

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-xwz9c

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-xwz9c

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.807s (1.808s including waiting). Image size: 177967631 bytes.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-xwz9c_ef250d0b-2398-45aa-9c0d-6361dc781f06

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-xwz9c_ef250d0b-2398-45aa-9c0d-6361dc781f06 became leader

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fr7x6

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-fr7x6

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-fr7x6

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-trgmc

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

authorino-operator-7b7bb4bc77-trgmc

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-rhkgh

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fr7x6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.278s (4.278s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fr7x6

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-trgmc

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-fr7x6_0b81b56d-808c-4a9c-95fe-216780173633

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-fr7x6_0b81b56d-808c-4a9c-95fe-216780173633 became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fr7x6

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-trgmc

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-trgmc

Created

Container created

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-rhkgh

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

authorino-operator-7b7bb4bc77-trgmc_8ad454c9-d674-4f3a-b0b5-4ff8ee68a06d

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-trgmc_8ad454c9-d674-4f3a-b0b5-4ff8ee68a06d became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-trgmc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.381s (1.381s including waiting). Image size: 167738465 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-rhkgh

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-rp492

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-rp492

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-rp492

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-rhkgh

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-rhkgh

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-rhkgh

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.694s (2.694s including waiting). Image size: 309650901 bytes.
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-869444d94f

SuccessfulCreate

Created pod: kube-auth-proxy-869444d94f-84r4k

openshift-ingress

replicaset-controller

kube-auth-proxy-869444d94f

SuccessfulCreate

Created pod: kube-auth-proxy-869444d94f-mkwbn

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-6b2gq

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b2gq

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-6b2gq

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7d699c9f7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7d699c9f7chc8s4

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7d699c9f7chc8s4

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-869444d94f-84r4k

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-869444d94f-84r4k

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-869444d94f-mkwbn

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7d699c9f7c from 0 to 1

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-869444d94f from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-869444d94f-mkwbn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"
(x3)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-rp492

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-ljl9r

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-rp492

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.508s (4.508s including waiting). Image size: 342538866 bytes.

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-dtzmt

kuadrant-system

multus

authorino-56c6c9ddd5-jfhw9

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7d699c9f7chc8s4

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-dtzmt

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7d699c9f7chc8s4

Created

Container created

kuadrant-system

multus

limitador-limitador-7c9b87d574-dtzmt

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-wq5qd

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-rp492

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-wq5qd

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-ljl9r

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-wq5qd

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-jfhw9

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7d699c9f7chc8s4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

multus

authorino-57f7f8659f-ljl9r

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b2gq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.199s (1.199s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b2gq

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-jfhw9

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b2gq

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-869444d94f-84r4k

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-869444d94f-84r4k

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-869444d94f-84r4k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.506s (2.506s including waiting). Image size: 188904677 bytes.

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-nkx9x

openshift-ingress

kubelet

kube-auth-proxy-869444d94f-mkwbn

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-869444d94f-mkwbn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.403s (2.403s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-869444d94f-mkwbn

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-jfhw9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.554s (2.554s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-jfhw9

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-wq5qd

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-wq5qd

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.952s (2.952s including waiting). Image size: 309650901 bytes.

cert-manager

multus

cert-manager-597b95cb84-nkx9x

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-nkx9x

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-dtzmt

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-dtzmt

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-dtzmt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.632s (2.632s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-ljl9r

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.688s (2.688s including waiting). Image size: 204096810 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-wq5qd

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-ljl9r

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-ljl9r

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-jfhw9

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-nkx9x

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 616ms (616ms including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-597b95cb84-nkx9x

Started

Container started

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-ljl9r

cert-manager

kubelet

cert-manager-597b95cb84-nkx9x

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

authorino-57f7f8659f-ljl9r

Killing

Stopping container authorino

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-l8dsg

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-l8dsg

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-l8dsg

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-l8dsg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.527s (1.527s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-l8dsg

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-l8dsg

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6b2gq

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-6b2gq

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

opendatahub

kserve-module-controller-manager-7566cf5fc8-l8dsg_72629e2c-719c-4a89-b642-8a9116cef602

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-l8dsg_72629e2c-719c-4a89-b642-8a9116cef602 became leader

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-hk4ts"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-5tmcp"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

multus

jobset-controller-manager-585f46ff54-gstjh

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

kubelet

jobset-controller-manager-585f46ff54-gstjh

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-585f46ff54

SuccessfulCreate

Created pod: jobset-controller-manager-585f46ff54-gstjh

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-585f46ff54 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

kubelet

jobset-controller-manager-585f46ff54-gstjh

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.888s (2.888s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-585f46ff54-gstjh

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-585f46ff54-gstjh

Started

Container started

openshift-jobset-operator

jobset-controller-manager-585f46ff54-gstjh_e0505171-0663-44d9-aff2-5392756e0154

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-585f46ff54-gstjh_e0505171-0663-44d9-aff2-5392756e0154 became leader

opendatahub

multus

maas-controller-56d4bb9f9f-9pwh4

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5c5b87b589 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-56d4bb9f9f from 0 to 1

opendatahub

replicaset-controller

maas-controller-5c5b87b589

SuccessfulCreate

Created pod: maas-controller-5c5b87b589-7fw2t

opendatahub

replicaset-controller

maas-controller-56d4bb9f9f

SuccessfulCreate

Created pod: maas-controller-56d4bb9f9f-9pwh4

opendatahub

kubelet

maas-controller-56d4bb9f9f-9pwh4

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8acc7a36ef8e7e615670bba6c3c869a03bf2edc0e33573acae63f13f19c9278c"

opendatahub

multus

maas-controller-5c5b87b589-7fw2t

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5c5b87b589-7fw2t

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8acc7a36ef8e7e615670bba6c3c869a03bf2edc0e33573acae63f13f19c9278c" in 2.155s (2.155s including waiting). Image size: 200069624 bytes.

opendatahub

kubelet

maas-controller-56d4bb9f9f-9pwh4

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8acc7a36ef8e7e615670bba6c3c869a03bf2edc0e33573acae63f13f19c9278c" in 2.292s (2.292s including waiting). Image size: 200069624 bytes.

opendatahub

kubelet

maas-controller-56d4bb9f9f-9pwh4

Started

Container started

opendatahub

kubelet

maas-controller-56d4bb9f9f-9pwh4

Created

Container created

opendatahub

maas-controller-56d4bb9f9f-9pwh4_5491d5de-92e3-48ac-9ef8-a7fe0c86d381

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-56d4bb9f9f-9pwh4_5491d5de-92e3-48ac-9ef8-a7fe0c86d381 became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-rxctj

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rxctj

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-rxctj

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-56d4bb9f9f-9pwh4

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-56d4bb9f9f

SuccessfulDelete

Deleted pod: maas-controller-56d4bb9f9f-9pwh4

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-56d4bb9f9f from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rxctj

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rxctj

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 9.71s (9.71s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rxctj

Started

Container started

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-nw46b

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nw46b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-nw46b

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-s47vd

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nw46b

Created

Container created

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nw46b

Started

Container started

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-ncjwb

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-jzhdq

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-dp2zp

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-dp2zp

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-s47vd

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

kserve-controller-manager-776cc66d47-s47vd

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-ncjwb

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

model-serving-api-75bd89fdfc-jzhdq

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-jzhdq

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

odh-model-controller-769875db56-ncjwb

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-dp2zp

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-skcpz

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-skcpz

opendatahub

kubelet

model-serving-api-75bd89fdfc-jzhdq

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-jzhdq

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-dp2zp

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-jzhdq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.639s (2.639s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-dp2zp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.81s (2.81s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-s47vd

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.989s (2.989s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-s47vd

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-dp2zp

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-s47vd

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-ncjwb

Created

Container created

opendatahub

llmisvc-controller-manager-869d5dcc5d-dp2zp_afd631e1-80ca-41aa-a4de-6ac35330697b

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-dp2zp_afd631e1-80ca-41aa-a4de-6ac35330697b became leader

opendatahub

kserve-controller-manager-776cc66d47-s47vd_7623be78-525d-4a6c-aabd-e0278ec549ad

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-s47vd_7623be78-525d-4a6c-aabd-e0278ec549ad became leader

opendatahub

odh-model-controller-769875db56-ncjwb_aadc454b-aa4d-4fce-86f0-ad151314ed93

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-ncjwb_aadc454b-aa4d-4fce-86f0-ad151314ed93 became leader

opendatahub

kubelet

odh-model-controller-769875db56-ncjwb

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-ncjwb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.526s (3.526s including waiting). Image size: 236755567 bytes.

opendatahub

maas-controller-5c5b87b589-7fw2t_2bfb6da1-a801-445f-9249-06827f5bd503

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5c5b87b589-7fw2t_2bfb6da1-a801-445f-9249-06827f5bd503 became leader
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-9dh4s

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-zsnt2

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-9dh4s

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-f7f688f59 from 0 to 1

kuadrant-system

multus

authorino-6889cbd8c4-9dh4s

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6889cbd8c4-9dh4s

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-zsnt2

kuadrant-system

replicaset-controller

authorino-f7f688f59

SuccessfulCreate

Created pod: authorino-f7f688f59-lvj75

kuadrant-system

kubelet

authorino-f7f688f59-lvj75

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-f7f688f59-lvj75

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-9dh4s

Created

Container created

kuadrant-system

kubelet

authorino-6889cbd8c4-9dh4s

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-9dh4s

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 675ms (675ms including waiting). Image size: 204096810 bytes.

kuadrant-system

multus

authorino-f7f688f59-lvj75

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-2bv6f

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-2bv6f

Created

Container created

kuadrant-system

kubelet

authorino-f7f688f59-lvj75

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 475ms (475ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-f7f688f59-lvj75

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-2bv6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-jfhw9

kuadrant-system

kubelet

authorino-56c6c9ddd5-jfhw9

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6889cbd8c4-9dh4s

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-2bv6f

Unhealthy

Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-2bv6f

ProbeError

Startup probe error: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-pnb5q

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-pnb5q

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-pnb5q

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-pnb5q

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-pnb5q

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-pnb5q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 457ms (457ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-dp2zp

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-dp2zp

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-qd9ff

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-qd9ff

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-qd9ff

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-qd9ff

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.456s (1.456s including waiting). Image size: 183926184 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-qd9ff

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-qd9ff

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-qd9ff_6686608a-9019-40b6-b22d-ee4254f7d476

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-qd9ff_6686608a-9019-40b6-b22d-ee4254f7d476 became leader

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-n2ljx

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-b8qh5
(x6)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n2ljx

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-n2ljx

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5f78687d5b-b8qh5

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-b8qh5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5f78687d5b-b8qh5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.165s (2.165s including waiting). Image size: 125280235 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n2ljx

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-b8qh5

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-b8qh5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n2ljx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n2ljx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.296s (2.296s including waiting). Image size: 125280235 bytes.

opendatahub

replicaset-controller

ai-gateway-controller-7b4cb8955

SuccessfulCreate

Created pod: ai-gateway-controller-7b4cb8955-jcvnm

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7b4cb8955 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7b4cb8955-jcvnm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7b4cb8955-jcvnm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 334ms (334ms including waiting). Image size: 183926184 bytes.

opendatahub

multus

ai-gateway-controller-7b4cb8955-jcvnm

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7b4cb8955-jcvnm

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7b4cb8955-jcvnm

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-pnb5q_264646ed-ac6c-4990-9568-a9381bf69ee5

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-pnb5q_264646ed-ac6c-4990-9568-a9381bf69ee5 became leader

opendatahub

kubelet

ai-gateway-controller-7d85675f98-qd9ff

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-qd9ff

opendatahub

kubelet

maas-controller-5c5b87b589-7fw2t

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:8acc7a36ef8e7e615670bba6c3c869a03bf2edc0e33573acae63f13f19c9278c" in 459ms (459ms including waiting). Image size: 200069624 bytes.
(x2)

opendatahub

kubelet

maas-controller-5c5b87b589-7fw2t

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:8acc7a36ef8e7e615670bba6c3c869a03bf2edc0e33573acae63f13f19c9278c"
(x2)

opendatahub

kubelet

maas-controller-5c5b87b589-7fw2t

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-5c5b87b589-7fw2t

Started

Container started

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-qtdgm

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-qtdgm

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-qtdgm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-qtdgm

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-qtdgm

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-qtdgm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.194s (1.194s including waiting). Image size: 98346788 bytes.

opendatahub

ai-gateway-controller-7b4cb8955-jcvnm_fd89de21-e983-47bf-8913-b81b1d5452c8

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7b4cb8955-jcvnm_fd89de21-e983-47bf-8913-b81b1d5452c8 became leader

opendatahub

maas-controller-5c5b87b589-7fw2t_b0022e8d-4c29-4d1a-bdd1-96901b1af7d6

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5c5b87b589-7fw2t_b0022e8d-4c29-4d1a-bdd1-96901b1af7d6 became leader

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-cns7p

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-cns7p

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-cns7p

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-cns7p

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-cns7p

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.043s (1.043s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-cns7p

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-jffqg

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-jffqg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 207ms (207ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-jffqg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-jffqg

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-jffqg

Started

Container started

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-jffqg

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-xvbrz

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-xvbrz

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-xvbrz

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 183ms (183ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-xvbrz

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-xvbrz

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-xvbrz

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8r7qx4

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8r7qx4

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8r7qx4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 186ms (186ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8r7qx4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8r7qx4

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8r7qx4

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

kubelet

echo-simulator-kserve-64b6f8f96c-g98cv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-g98cv

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

multus

echo-simulator-kserve-64b6f8f96c-g98cv

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-xdsnd

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xdsnd

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-g98cv

Started

Container started

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-xdsnd

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xdsnd

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xdsnd

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xdsnd

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 214ms (214ms including waiting). Image size: 98346788 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-g98cv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.601s (1.601s including waiting). Image size: 78208878 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-g98cv

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-5fpf4

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5fpf4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-5fpf4

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5fpf4

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5fpf4

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-5fpf4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 230ms (230ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

replicaset-controller

authorino-5774ffdd7b

SuccessfulCreate

Created pod: authorino-5774ffdd7b-lhvxf

kuadrant-system

kubelet

authorino-5774ffdd7b-lhvxf

Created

Container created

kuadrant-system

kubelet

authorino-5774ffdd7b-lhvxf

Started

Container started

kuadrant-system

multus

authorino-5774ffdd7b-lhvxf

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5774ffdd7b-lhvxf

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-5774ffdd7b-lhvxf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 446ms (446ms including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-f7f688f59

SuccessfulDelete

Deleted pod: authorino-f7f688f59-lvj75
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-f7f688f59 from 1 to 0

kuadrant-system

kubelet

authorino-f7f688f59-lvj75

Killing

Stopping container authorino

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-6njrd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-6njrd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qqbk5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qqbk5

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-6njrd

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-q9ng9

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6dcf757899-qqbk5

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 1 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-q9ng9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-6njrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6dcf757899-6njrd

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6dcf757899-q9ng9

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-qqbk5

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qqbk5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-q9ng9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-q9ng9

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-q9ng9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.81s (2.81s including waiting). Image size: 183555333 bytes.
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qqbk5

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-6njrd

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qqbk5

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-6njrd

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-q9ng9

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-q9ng9

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-tvj2n

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tvj2n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tvj2n

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tvj2n

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6dcf757899-tvj2n

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 4 to 5
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tvj2n

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tvj2n

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-f7d8050f-openshift-default-7cc75b8cb9

SuccessfulCreate

Created pod: e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g

openshift-ingress

gateway_labeler_controller

e2e-ait-48afdd9e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-48afdd9e

openshift-ingress

deployment-controller

e2e-ait-48afdd9e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-48afdd9e-openshift-default-6974b885d7 from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-f7d8050f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f7d8050f-openshift-default-7cc75b8cb9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-f7d8050f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f7d8050f

openshift-ingress

deployment-controller

e2e-migrate-b77c9bba-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc

SuccessfulCreate

Created pod: e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

openshift-ingress

replicaset-controller

e2e-ait-48afdd9e-openshift-default-6974b885d7

SuccessfulCreate

Created pod: e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9

openshift-ingress

gateway_labeler_controller

e2e-migrate-b77c9bba-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-b77c9bba-gw

openshift-ingress

multus

e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-ed302a08-openshift-default-545bd55fff

SuccessfulCreate

Created pod: e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t

openshift-ingress

deployment-controller

e2e-ait-ed302a08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ed302a08-openshift-default-545bd55fff from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-ed302a08

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ed302a08

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b77c9bba-b86bff66

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-b77c9bba-b86bff66-9psmc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b77c9bba: serviceaccount "payload-processing-e2e-migrate-b77c9bba" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b77c9bba-b86bff66

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-b77c9bba-b86bff66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b77c9bba: serviceaccount "payload-processing-e2e-migrate-b77c9bba" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-b77c9bba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-b77c9bba-b86bff66 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-b77c9bba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5-q7tvf

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5-q7tvf

openshift-ingress

kubelet

payload-processing-e2e-migrate-b77c9bba-b86bff66-9psmc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5-q7tvf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-b77c9bba-b86bff66-9psmc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5-q7tvf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5-q7tvf

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f7d8050f-9477df678

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f7d8050f-9477df678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f7d8050f: serviceaccount "payload-processing-e2e-ait-f7d8050f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f7d8050f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f7d8050f-85c496447 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-b77c9bba-b86bff66-9psmc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f7d8050f-85c496447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f7d8050f-85c496447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f7d8050f: serviceaccount "payload-processing-e2e-ait-f7d8050f" not found

openshift-ingress

multus

payload-processing-e2e-migrate-b77c9bba-b86bff66-9psmc

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f7d8050f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f7d8050f-9477df678 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-f7d8050f-9477df678-26mhs

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-48afdd9e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-48afdd9e-6b954754c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-f7d8050f-9477df678-26mhs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-48afdd9e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-48afdd9e-7d9796f4dd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f7d8050f-85c496447-vzmqt

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-f7d8050f-9477df678-26mhs

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f7d8050f-85c496447-vzmqt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f7d8050f-85c496447-vzmqt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-f7d8050f-85c496447-vzmqt

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f7d8050f-9477df678

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f7d8050f-9477df678-26mhs

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f7d8050f-85c496447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f7d8050f-85c496447-vzmqt

openshift-ingress

kubelet

payload-processing-e2e-ait-f7d8050f-9477df678-26mhs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48afdd9e-6b954754c-sx2qk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-48afdd9e-7d9796f4dd-s76rr

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-48afdd9e-6b954754c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-48afdd9e-6b954754c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-48afdd9e: serviceaccount "payload-processing-e2e-ait-48afdd9e" not found

openshift-ingress

deployment-controller

e2e-derive-a33e5151-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-a33e5151-openshift-default-7ff8bf87cc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-a33e5151

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-a33e5151

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48afdd9e-6b954754c-sx2qk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48afdd9e-6b954754c-sx2qk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-48afdd9e-6b954754c-sx2qk

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-a33e5151-openshift-default-7ff8bf87cc

SuccessfulCreate

Created pod: e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq

openshift-ingress

multus

payload-processing-e2e-ait-48afdd9e-7d9796f4dd-s76rr

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-48afdd9e-7d9796f4dd-s76rr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-48afdd9e-7d9796f4dd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-48afdd9e-7d9796f4dd-s76rr

openshift-ingress

kubelet

payload-processing-e2e-ait-48afdd9e-7d9796f4dd-s76rr

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-48afdd9e-6b954754c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-48afdd9e-6b954754c-sx2qk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-48afdd9e-7d9796f4dd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-48afdd9e-7d9796f4dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-48afdd9e: serviceaccount "payload-processing-e2e-ait-48afdd9e" not found

openshift-ingress

multus

e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ed302a08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ed302a08-847f99dd5b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ed302a08: serviceaccount "payload-processing-e2e-ait-ed302a08" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-m9k6p

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ed302a08-847f99dd5b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ed302a08-847f99dd5b-79tbt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ed302a08-847f99dd5b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ed302a08-847f99dd5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ed302a08: serviceaccount "payload-processing-e2e-ait-ed302a08" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ed302a08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-ed302a08-847f99dd5b-79tbt

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-m9k6p

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ed302a08-847f99dd5b-79tbt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-m9k6p

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-ed302a08-847f99dd5b-79tbt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-m9k6p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-ed302a08-847f99dd5b-79tbt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.443s (2.443s including waiting). Image size: 125280235 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-m9k6p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.406s (2.406s including waiting). Image size: 125280235 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-ed302a08-847f99dd5b-79tbt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-m9k6p

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a33e5151-6655fc458c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-a33e5151-6655fc458c-lkp5p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a33e5151-6655fc458c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-a33e5151-6655fc458c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a33e5151: serviceaccount "payload-processing-e2e-derive-a33e5151" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-a33e5151

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-a33e5151-85fc5ccf7b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-a33e5151-85fc5ccf7b-nzgfr

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a33e5151-85fc5ccf7b

SuccessfulCreate

Created pod: payload-processing-e2e-derive-a33e5151-85fc5ccf7b-nzgfr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-a33e5151

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-a33e5151-6655fc458c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a33e5151-85fc5ccf7b

FailedCreate

Error creating: pods "payload-processing-e2e-derive-a33e5151-85fc5ccf7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a33e5151: serviceaccount "payload-processing-e2e-derive-a33e5151" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a33e5151-6655fc458c-lkp5p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-a33e5151-85fc5ccf7b-nzgfr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-a33e5151-85fc5ccf7b-nzgfr

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-derive-a33e5151-6655fc458c-lkp5p

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-a33e5151-85fc5ccf7b-nzgfr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a33e5151-6655fc458c-lkp5p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a33e5151-6655fc458c-lkp5p

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-48afdd9e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-48afdd9e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b77c9bba-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b77c9bba-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ed302a08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ed302a08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f7d8050f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-48afdd9e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-48afdd9e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f7d8050f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b77c9bba-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b77c9bba-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ed302a08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ed302a08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-b77c9bba-b86bff66-9psmc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b77c9bba-7877cfb4f5-q7tvf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f7d8050f-85c496447-vzmqt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f7d8050f-9477df678-26mhs

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-a33e5151-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-a33e5151-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-48afdd9e-7d9796f4dd-s76rr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48afdd9e-6b954754c-sx2qk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-f7d8050f-openshift-default-7cc75b8cb9-56t2g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ed302a08-7bd8df4f9-m9k6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ed302a08-847f99dd5b-79tbt

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-0ddc26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-0ddc26

openshift-ingress

kubelet

e2e-ait-48afdd9e-openshift-default-6974b885d7-nsql9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-a47385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a47385-openshift-default-69556b768f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-a47385

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-a47385

openshift-ingress

replicaset-controller

e2e-worker-w4-a47385-openshift-default-69556b768f

SuccessfulCreate

Created pod: e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5

SuccessfulCreate

Created pod: e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn

openshift-ingress

deployment-controller

e2e-worker-w2-b2ef42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b2ef42-openshift-default-75bc5554f5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-b2ef42

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-b2ef42

openshift-ingress

kubelet

e2e-ait-ed302a08-openshift-default-545bd55fff-wcb2t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-0ddc26-openshift-default-7f95765489

SuccessfulCreate

Created pod: e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt

openshift-ingress

multus

e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-0ddc26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-0ddc26-openshift-default-7f95765489 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-b77c9bba-gw-openshift-default-797f684ffc-j2q59

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877

SuccessfulCreate

Created pod: e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf

openshift-ingress

deployment-controller

e2e-worker-w0-f6f7d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f6f7d5-openshift-default-64d55dd877 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-f6f7d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-f6f7d5

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a33e5151-6655fc458c-lkp5p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a33e5151-85fc5ccf7b-nzgfr

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-a47385

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-a47385-7495675595 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a47385-7495675595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-a47385-7495675595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a47385: serviceaccount "payload-processing-e2e-worker-w4-a47385" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a47385-5f469786c4

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-a47385-5f469786c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a47385: serviceaccount "payload-processing-e2e-worker-w4-a47385" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-a47385

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-a47385-5f469786c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a47385-7495675595-cqb8h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a47385-7495675595-cqb8h

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w4-a47385-5f469786c4-qwf5c

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a47385-7495675595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-a47385-7495675595-cqb8h

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a47385-5f469786c4-qwf5c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a47385-7495675595-cqb8h

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-a47385-7495675595-cqb8h

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a47385-5f469786c4

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-a47385-5f469786c4-qwf5c

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a47385-5f469786c4-qwf5c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a47385-5f469786c4-qwf5c

Created

Container created

openshift-ingress

kubelet

e2e-derive-a33e5151-openshift-default-7ff8bf87cc-7xsfq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-0ddc26: serviceaccount "payload-processing-e2e-worker-w3-0ddc26" not found

openshift-ingress

replicaset-controller

e2e-worker-w1-a759a1-openshift-default-6bbf9c4459

SuccessfulCreate

Created pod: e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-0ddc26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-rtlmq

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-0ddc26: serviceaccount "payload-processing-e2e-worker-w3-0ddc26" not found

openshift-ingress

deployment-controller

e2e-worker-w1-a759a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a759a1-openshift-default-6bbf9c4459 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-a759a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-a759a1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-0ddc26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-rtlmq

openshift-ingress

multus

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-rtlmq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-rtlmq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-rtlmq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-b2ef42

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-b2ef42-79fb677864 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-b2ef42-79fb677864

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-b2ef42-79fb677864-pscfj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-b2ef42-79fb677864

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-b2ef42-79fb677864-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-b2ef42: serviceaccount "payload-processing-e2e-worker-w2-b2ef42" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-b2ef42: serviceaccount "payload-processing-e2e-worker-w2-b2ef42" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-b2ef42

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-v5scm

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-v5scm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-f6f7d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-f6f7d5-97c74567d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.476s (2.476s including waiting). Image size: 125280235 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b2ef42-79fb677864-pscfj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b2ef42-79fb677864-pscfj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b2ef42-79fb677864-pscfj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-b2ef42-79fb677864-pscfj

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-v5scm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-v5scm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-v5scm

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-f6f7d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-x7ncz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f6f7d5: serviceaccount "payload-processing-e2e-worker-w0-f6f7d5" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f6f7d5-97c74567d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-f6f7d5-97c74567d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f6f7d5: serviceaccount "payload-processing-e2e-worker-w0-f6f7d5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f6f7d5-97c74567d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-f6f7d5-97c74567d-m5qpf

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f6f7d5-97c74567d-m5qpf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f6f7d5-97c74567d-m5qpf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-f6f7d5-97c74567d-m5qpf

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f6f7d5-97c74567d-m5qpf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-x7ncz

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-x7ncz

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-x7ncz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-x7ncz

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-a759a1: serviceaccount "payload-processing-e2e-worker-w1-a759a1" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-a759a1-6bd858c9f6

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-a759a1: serviceaccount "payload-processing-e2e-worker-w1-a759a1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-a759a1-6bd858c9f6

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-rcpbt

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-a759a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-a759a1-6bd858c9f6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-a759a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-mqlhg

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-mqlhg

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-mqlhg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-mqlhg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-mqlhg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-rcpbt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-rcpbt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-rcpbt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-rcpbt

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

ProbeError

Readiness probe error: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

Unhealthy

Readiness probe failed: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a47385-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a47385-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a47385-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a47385-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f6f7d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f6f7d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-0ddc26-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-0ddc26-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f6f7d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f6f7d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b2ef42-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b2ef42-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a759a1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a759a1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f6f7d5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877

SuccessfulCreate

Created pod: e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph

openshift-ingress

deployment-controller

e2e-worker-w0-f6f7d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f6f7d5-openshift-default-64d55dd877 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-0ddc26-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-0ddc26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-0ddc26-openshift-default-7f95765489 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-0ddc26-openshift-default-7f95765489

SuccessfulCreate

Created pod: e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-77cdcd47c from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-77cdcd47c

FailedCreate

Error creating: pods "payload-processing-external-model-77cdcd47c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-77cdcd47c-pbnr9

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-77cdcd47c-pbnr9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-77cdcd47c-pbnr9

Created

Container created

models-as-a-service

multus

payload-processing-external-model-77cdcd47c-pbnr9

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-77cdcd47c

SuccessfulCreate

Created pod: payload-processing-external-model-77cdcd47c-pbnr9

openshift-ingress

deployment-controller

e2e-worker-w4-a47385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a47385-openshift-default-69556b768f from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-a47385-openshift-default-69556b768f

SuccessfulCreate

Created pod: e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a47385-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5

SuccessfulCreate

Created pod: e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b2ef42-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-b2ef42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b2ef42-openshift-default-75bc5554f5 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

Created

Container created

openshift-ingress

multus

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f6f7d5-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877

SuccessfulCreate

Created pod: e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t

openshift-ingress

deployment-controller

e2e-worker-w0-f6f7d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f6f7d5-openshift-default-64d55dd877 from 2 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-6dcf757899-cvhp5

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6dcf757899-wltdx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6dcf757899-tqkjg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6dcf757899-tzpc7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6dcf757899

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6dcf757899-qnfsg

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 5 to 10

openshift-ingress

multus

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tzpc7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tqkjg

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-58db6964f9

SuccessfulCreate

Created pod: payload-processing-external-model-58db6964f9-4h2sp

models-as-a-service

kubelet

payload-processing-external-model-58db6964f9-4h2sp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-cvhp5

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-cvhp5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-58db6964f9-4h2sp

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-wltdx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-cvhp5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-cvhp5

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-58db6964f9 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-wltdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-qnfsg

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qnfsg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qnfsg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qnfsg

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-wltdx

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tzpc7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tzpc7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-tzpc7

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tqkjg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tqkjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6dcf757899-tqkjg

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-58db6964f9-4h2sp

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-58db6964f9-4h2sp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-wltdx

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-58db6964f9

SuccessfulDelete

Deleted pod: payload-processing-external-model-58db6964f9-4h2sp

models-as-a-service

multus

payload-processing-external-model-d66597b7c-bc8tq

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-d66597b7c

SuccessfulCreate

Created pod: payload-processing-external-model-d66597b7c-bc8tq

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-58db6964f9 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-d66597b7c-bc8tq

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-d66597b7c-bc8tq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-58db6964f9-4h2sp

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-d66597b7c-bc8tq

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x4)

models-as-a-service

kubelet

payload-processing-external-model-58db6964f9-4h2sp

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-61485f235dab" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qnfsg

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tqkjg

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tqkjg

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tzpc7

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tzpc7

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qqbk5

Unhealthy

Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qnfsg

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-cvhp5

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-cvhp5

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qqbk5

ProbeError

Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-6njrd

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-wltdx

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-wltdx

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-6njrd

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-wltdx

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-wltdx

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-77cdcd47c from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-77cdcd47c-pbnr9

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-77cdcd47c

SuccessfulDelete

Deleted pod: payload-processing-external-model-77cdcd47c-pbnr9

models-as-a-service

kubelet

payload-processing-external-model-5d7cd86ff8-98ffs

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5d7cd86ff8-98ffs

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5d7cd86ff8-98ffs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5d7cd86ff8-98ffs

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-5d7cd86ff8

SuccessfulCreate

Created pod: payload-processing-external-model-5d7cd86ff8-98ffs

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5d7cd86ff8 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-d66597b7c

SuccessfulDelete

Deleted pod: payload-processing-external-model-d66597b7c-bc8tq

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-d66597b7c from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-d66597b7c-bc8tq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-cvhp5

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tqkjg

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-tqkjg

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qnfsg

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-qnfsg

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-cvhp5

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-d66597b7c

SuccessfulCreate

Created pod: payload-processing-external-model-d66597b7c-z44ct
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-d66597b7c from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-d66597b7c-z44ct

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-d66597b7c-z44ct

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-d66597b7c-z44ct

Created

Container created

models-as-a-service

multus

payload-processing-external-model-d66597b7c-z44ct

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5d7cd86ff8 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5d7cd86ff8

SuccessfulDelete

Deleted pod: payload-processing-external-model-5d7cd86ff8-98ffs

models-as-a-service

kubelet

payload-processing-external-model-5d7cd86ff8-98ffs

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-d66597b7c-z44ct

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-wltdx

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-2bv6f

ProbeError

Readiness probe error: Get "http://10.133.0.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-2bv6f

Unhealthy

Readiness probe failed: Get "http://10.133.0.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6dcf757899-wltdx

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a47385-5f469786c4-qwf5c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a47385-7495675595-cqb8h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-v5scm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b2ef42-79fb677864-pscfj

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a47385-7495675595-cqb8h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a47385-5f469786c4-qwf5c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-0ddc26-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-0ddc26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-0ddc26-openshift-default-7f95765489 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-0ddc26-openshift-default-7f95765489

SuccessfulCreate

Created pod: e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

openshift-ingress

multus

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f6f7d5-97c74567d-m5qpf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-x7ncz

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b2ef42-6dfc59cf79-v5scm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b2ef42-79fb677864-pscfj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-4dkmm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-a47385-openshift-default-69556b768f-hzdxd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-mqlhg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-rcpbt

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f6f7d5-569c9c7c5f-x7ncz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f6f7d5-97c74567d-m5qpf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-x9m2q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-b2ef42-openshift-default-75bc5554f5-4pmzn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-rtlmq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-h8h4t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-brrbf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f6f7d5-openshift-default-64d55dd877-77bph

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a759a1-6bd858c9f6-rcpbt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a759a1-77d88f6cf9-mqlhg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-a759a1-openshift-default-6bbf9c4459-wrrmc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-0ddc26-6dbbc755cf-rtlmq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-0ddc26-ccfb77f7d-ndmf4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-ww7zv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-jdwqt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-0ddc26-openshift-default-7f95765489-w9w2g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503