Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-7mxbc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-7mxbc to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd to ip-10-0-138-176.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-58c455bdd6-nh2r9 to ip-10-0-138-176.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-58c455bdd6-cd8zt to ip-10-0-133-124.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-58c455bdd6-7g2mr to ip-10-0-128-246.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-7rt9f

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-7rt9f to ip-10-0-128-246.ec2.internal

opendatahub

test-curl-7628-b718f6

Scheduled

Successfully assigned opendatahub/test-curl-7628-b718f6 to ip-10-0-138-176.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-6mt6k

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-6mt6k to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-45dc34-79f9556b56-st7qr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-45dc34-79f9556b56-st7qr to ip-10-0-138-176.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6545b48489hbqng

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489hbqng to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-54599e13-openshift-default-d8998f799-mwtl5 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw to ip-10-0-133-124.ec2.internal

opendatahub

test-curl-7628-b6f680

Scheduled

Successfully assigned opendatahub/test-curl-7628-b6f680 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x to ip-10-0-133-124.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-ghw27

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-ghw27 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-380c08-65f99966c6-8p2v9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-380c08-65f99966c6-8p2v9 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-mlkk9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-mlkk9 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-921450-8d6546c9b-5pxxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-921450-8d6546c9b-5pxxc to ip-10-0-138-176.ec2.internal

opendatahub

test-curl-7622-99ea9a

Scheduled

Successfully assigned opendatahub/test-curl-7622-99ea9a to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-rgb5c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-rgb5c to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-skjjq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-skjjq to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-rvhxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-rvhxf to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-dtq2s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-dtq2s to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-lvpxv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-lvpxv to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-1a2436-567f469f4-qmp5p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-1a2436-567f469f4-qmp5p to ip-10-0-133-124.ec2.internal

opendatahub

test-curl-7619-cc48c5

Scheduled

Successfully assigned opendatahub/test-curl-7619-cc48c5 to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-wzn42

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-wzn42 to ip-10-0-133-124.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-h44fj

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-h44fj to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-w8sfs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-w8sfs to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-mt-0c6613ea-openshift-default-6684df784f-f257t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-0c6613ea-openshift-default-6684df784f-f257t to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-w98z7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-w98z7 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-wgrr6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-wgrr6 to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

Scheduled

Successfully assigned openshift-ingress/e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44 to ip-10-0-133-124.ec2.internal

kuadrant-system

authorino-5748484d8c-wtztm

Scheduled

Successfully assigned kuadrant-system/authorino-5748484d8c-wtztm to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-wwft7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-wwft7 to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-x2rr2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x2rr2 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6 to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-xhh6v

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-xhh6v to ip-10-0-128-246.ec2.internal

kuadrant-system

authorino-57f7f8659f-tf6wx

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-tf6wx to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg

Scheduled

Successfully assigned openshift-ingress/e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-vlm9c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vlm9c to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-xkggb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-xkggb to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-xkvhq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-xkvhq to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn to ip-10-0-133-124.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-z2dn9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-z2dn9 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4 to ip-10-0-138-176.ec2.internal

kuadrant-system

authorino-6889cbd8c4-d4mxd

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-d4mxd to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-v7b8p

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-v7b8p to ip-10-0-133-124.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-tpnm7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-tpnm7 to ip-10-0-133-124.ec2.internal

kuadrant-system

authorino-6f6944bcdd-fz4zb

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-fz4zb to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-t7sdc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-t7sdc to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-qwf7s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-qwf7s to ip-10-0-138-176.ec2.internal

kuadrant-system

authorino-85779f77c6-shks7

Scheduled

Successfully assigned kuadrant-system/authorino-85779f77c6-shks7 to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-p6n4s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-p6n4s to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-noten-4c75d7-openshift-default-59bbf9cdb5-qrhzh

Scheduled

Successfully assigned openshift-ingress/e2e-noten-4c75d7-openshift-default-59bbf9cdb5-qrhzh to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-fkxzr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-fkxzr to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5 to ip-10-0-133-124.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-f5f5q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-f5f5q to ip-10-0-138-176.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-k8hhs

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-k8hhs to ip-10-0-138-176.ec2.internal

opendatahub

test-curl-7619-4e036a

Scheduled

Successfully assigned opendatahub/test-curl-7619-4e036a to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7 to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-675070-5bf74cf574-r4wfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-675070-5bf74cf574-r4wfr to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-ms29d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-ms29d to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-fskbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-fskbl to ip-10-0-138-176.ec2.internal

opendatahub

test-curl-7616-ba9af8

Scheduled

Successfully assigned opendatahub/test-curl-7616-ba9af8 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-fe1374-65cf8c997d-5j2vz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-fe1374-65cf8c997d-5j2vz to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-afc614-78f958bbd8-dgrmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-afc614-78f958bbd8-dgrmm to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb-4q4fr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb-4q4fr to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2 to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-dxjft

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-dxjft to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf to ip-10-0-133-124.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-9rhcl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-9rhcl to ip-10-0-133-124.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-7lhc4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-7lhc4 to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-7jqjz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-7jqjz to ip-10-0-128-246.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-76h9j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-76h9j to ip-10-0-133-124.ec2.internal

opendatahub

test-curl-7616-b9f8ed

Scheduled

Successfully assigned opendatahub/test-curl-7616-b9f8ed to ip-10-0-138-176.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-77d8c79567-5b95c

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-5b95c to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2 to ip-10-0-133-124.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-v4fq8

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-v4fq8 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2 to ip-10-0-138-176.ec2.internal

openshift-ingress

router-default-ff9667845-fjrpd

FailedScheduling

no nodes available to schedule pods

opendatahub

test-curl-7616-ac3d93

Scheduled

Successfully assigned opendatahub/test-curl-7616-ac3d93 to ip-10-0-128-246.ec2.internal

openshift-ingress

router-default-ff9667845-fjrpd

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-ff9667845-fjrpd

Scheduled

Successfully assigned openshift-ingress/router-default-ff9667845-fjrpd to ip-10-0-128-246.ec2.internal

opendatahub

test-curl-7616-aaf25a

Scheduled

Successfully assigned opendatahub/test-curl-7616-aaf25a to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b-ppvqf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b-ppvqf to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-be7f9e-576d7866d4-9mpwv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-be7f9e-576d7866d4-9mpwv to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-a4f3f0-594b877768-ctrsw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-a4f3f0-594b877768-ctrsw to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-50b278-fd5695c7b-mdddw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-50b278-fd5695c7b-mdddw to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-mt-15e8827b-787b47bbf6-tclcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-15e8827b-787b47bbf6-tclcb to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn to ip-10-0-138-176.ec2.internal

opendatahub

odh-model-controller-769875db56-9jr6v

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-9jr6v to ip-10-0-128-246.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-dhkgf

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-dhkgf to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-wd789 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-mt-0c6613ea-86469f66f4-5bklf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-0c6613ea-86469f66f4-5bklf to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j to ip-10-0-128-246.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-59st9

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-59st9 to ip-10-0-133-124.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-h2877

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-h2877 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2 to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m to ip-10-0-128-246.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-bsck5

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bsck5 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-mt-0c6613ea-86469f66f4-2zwb7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-0c6613ea-86469f66f4-2zwb7 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj to ip-10-0-138-176.ec2.internal

opendatahub

maas-controller-76f74769d4-kf4sm

Scheduled

Successfully assigned opendatahub/maas-controller-76f74769d4-kf4sm to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

Scheduled

Successfully assigned openshift-ingress/e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst to ip-10-0-138-176.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-8bfcq

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-8bfcq to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-57bf5177-7879c68c96-896r4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-57bf5177-7879c68c96-896r4 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f826dd-b9f9b8586-jjsqm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f826dd-b9f9b8586-jjsqm to ip-10-0-138-176.ec2.internal

opendatahub

maas-controller-67cc46c64-66wvf

Scheduled

Successfully assigned opendatahub/maas-controller-67cc46c64-66wvf to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f826dd-66fc94df7b-vd626

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f826dd-66fc94df7b-vd626 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-76135e-759fd4f54d-jcj6v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-76135e-759fd4f54d-jcj6v to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-76135e-5d8b8684b6-g4jr8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-76135e-5d8b8684b6-g4jr8 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-44379a-6c575b68f4-pkdt7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-44379a-6c575b68f4-pkdt7 to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-6c557

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-6c557 to ip-10-0-133-124.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-rlk29

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-rlk29 to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-54599e13-9fdd4c687-9dncf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-54599e13-9fdd4c687-9dncf to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-8f6d8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-8f6d8 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-m9gg7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-m9gg7 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-10f1a3-d55fc9547-kj7nd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-10f1a3-d55fc9547-kj7nd to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2ee874-69fddfb67-hscz8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2ee874-69fddfb67-hscz8 to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-6qqzg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-6qqzg to ip-10-0-128-246.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dv6zs

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-dv6zs to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-44379a-644486f9dd-jgqh6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-44379a-644486f9dd-jgqh6 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-17df15-dbdfd998b-949th

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-17df15-dbdfd998b-949th to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-17df15-77f8475476-bmgzk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-17df15-77f8475476-bmgzk to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-5hmsm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-5hmsm to ip-10-0-133-124.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-5cfxk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-5cfxk to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f42594-87777b966-2nn2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f42594-87777b966-2nn2h to ip-10-0-133-124.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-4n5fx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-4n5fx to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4b709d-5df8f677bc-b4srr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4b709d-5df8f677bc-b4srr to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-46d6l

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-46d6l to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz to ip-10-0-128-246.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-nwq95

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-nwq95 to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f42594-7c6f78d84-zkpr2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f42594-7c6f78d84-zkpr2 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e9b146-74dbdb8b44-hzqmb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e9b146-74dbdb8b44-hzqmb to ip-10-0-133-124.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-jzvfr

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-jzvfr to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e9b146-6f5c4477d6-wd4nj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e9b146-6f5c4477d6-wd4nj to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-npw74 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e9096a-685c586796-k9fgv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e9096a-685c586796-k9fgv to ip-10-0-138-176.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-76597d6855-2pbp9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-76597d6855-2pbp9 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f15587-7cccff6f5-89g5c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f15587-7cccff6f5-89g5c to ip-10-0-138-176.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-bx4v6

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bx4v6 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv to ip-10-0-133-124.ec2.internal

openshift-ingress

kube-auth-proxy-7ffc6d98d7-wrwtb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ffc6d98d7-wrwtb to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447-5n5xd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447-5n5xd to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9-m89jr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9-m89jr to ip-10-0-138-176.ec2.internal

openshift-ingress

kube-auth-proxy-7ffc6d98d7-pkgv6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ffc6d98d7-pkgv6 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b33a49-6f47646bf9-lpsfd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b33a49-6f47646bf9-lpsfd to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-zfdxn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-zfdxn to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw to ip-10-0-138-176.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-r4k2t

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-r4k2t to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-de14f2-689d7c47c5-lnpph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-de14f2-689d7c47c5-lnpph to ip-10-0-128-246.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-j44sc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-j44sc to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-1e0b31-67474fb659-w9xtn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-1e0b31-67474fb659-w9xtn to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-ba56e909-c84888fc5-mm82n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ba56e909-c84888fc5-mm82n to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-160bf8-74f657fbf9-kfw2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-160bf8-74f657fbf9-kfw2h to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-q4ttx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-q4ttx to ip-10-0-138-176.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-dctgm

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-dctgm to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-nt76m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-nt76m to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-713dc8-798785c495-lqlhs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-713dc8-798785c495-lqlhs to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-c4k7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-c4k7q to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-88bvg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-88bvg to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-sjkjz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-sjkjz to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79-ltfgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79-ltfgp to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-r5frb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-r5frb to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-tlrg5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-tlrg5 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-nl5nn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-nl5nn to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-6wq4j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-6wq4j to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-s9pmv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-s9pmv to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-t98wq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-t98wq to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-7smvc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-7smvc to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-8ln4k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-8ln4k to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-xtrvj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-xtrvj to ip-10-0-128-246.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-7s88v

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-7s88v to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-jrdl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-jrdl6 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-zvsc8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-zvsc8 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-9rrgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-9rrgg to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-d64ml

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-d64ml to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c-mlnfd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c-mlnfd to ip-10-0-138-176.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-d74mc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d74mc to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs to ip-10-0-138-176.ec2.internal

openshift-jobset-operator

jobset-controller-manager-84f5bbc5c6-6rr5p

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-84f5bbc5c6-6rr5p to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-011d6f-cc789d486-srcwt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-011d6f-cc789d486-srcwt to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-011d6f-85479995f5-54sn4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-011d6f-85479995f5-54sn4 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6 to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-2kmj8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-2kmj8 to ip-10-0-138-176.ec2.internal

cert-manager

cert-manager-597b95cb84-t2654

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-t2654 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m to ip-10-0-138-176.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-nscmh

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-nscmh to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5-q85dn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5-q85dn to ip-10-0-138-176.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-nxg2g

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-nxg2g to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-011d6f-6747d9ddd4-bhn8d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-011d6f-6747d9ddd4-bhn8d to ip-10-0-138-176.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-57kj9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-57kj9 to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987-gcz4x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987-gcz4x to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95-hh5lx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95-hh5lx to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f42594-5669779bc-7249d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f42594-5669779bc-7249d to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-6jr84

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-6jr84 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl to ip-10-0-133-124.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8clmp5

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8clmp5 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc-7blzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc-7blzv to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-17df15-784cb9f975-7grmk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-17df15-784cb9f975-7grmk to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-44379a-79d8645f67-llqwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-44379a-79d8645f67-llqwl to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5-q8xgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5-q8xgr to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-76135e-6b67694855-jkbgw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-76135e-6b67694855-jkbgw to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7-4fqtg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7-4fqtg to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755-t8pkx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755-t8pkx to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f826dd-695db48787-488nc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f826dd-695db48787-488nc to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-xw6rx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-xw6rx to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-2csfr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-2csfr to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw to ip-10-0-138-176.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-qq7fh

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-qq7fh to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-5jbdk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-5jbdk to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-15e8827b-55679df55-xq5t6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-15e8827b-55679df55-xq5t6 to ip-10-0-128-246.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-f37ca7-85fcd85f88-xc8cv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f37ca7-85fcd85f88-xc8cv to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-daf3ba-766f4d7b84-bnhf6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-daf3ba-766f4d7b84-bnhf6 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f-fv7sd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f-fv7sd to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c-8k98q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c-8k98q to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475-st662

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475-st662 to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79-8rgjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79-8rgjs to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-xxv8l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-xxv8l to ip-10-0-138-176.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-kq2gj

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-kq2gj to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-798lh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-798lh to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-4xv4f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-4xv4f to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-jbckm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-jbckm to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-jxlmq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-jxlmq to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-rgj6w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-rgj6w to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-pmqhf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-pmqhf to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-5snxw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-5snxw to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-wk8g4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-wk8g4 to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-gcv88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-gcv88 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-xs76b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-xs76b to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-380c08-67478544f9-4pdqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-380c08-67478544f9-4pdqp to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-rqxz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-rqxz2 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-99nqx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-99nqx to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-bl75c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-bl75c to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-97rs5

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-97rs5 to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-ait-54599e13-69cdd8dfb-fnppd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-54599e13-69cdd8dfb-fnppd to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-ait-594f46d3-86dd96cf4d-vpwfb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-594f46d3-86dd96cf4d-vpwfb to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a521cf49-6ccf69fbd-bvmjm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a521cf49-6ccf69fbd-bvmjm to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-10f1a3-6f6f779d4b-95h9b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-10f1a3-6f6f779d4b-95h9b to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-2ee874-5b975bd4-drq62

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2ee874-5b975bd4-drq62 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4b709d-7d96656586-hxnbn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4b709d-7d96656586-hxnbn to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744 to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx to ip-10-0-133-124.ec2.internal

models-as-a-service

payload-processing-external-model-595fbb7bb9-vgwvw

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-595fbb7bb9-vgwvw to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-f15587-674b5c966-d8pd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f15587-674b5c966-d8pd8 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8 to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-50b278-99494fc99-wv8sj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-50b278-99494fc99-wv8sj to ip-10-0-138-176.ec2.internal

models-as-a-service

payload-processing-external-model-6656cd76c4-lf7dr

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6656cd76c4-lf7dr to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c52ec7-f6884465b-465q7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c52ec7-f6884465b-465q7 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb-fh4tt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb-fh4tt to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-551d0b-6686dd876d-qvsgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-551d0b-6686dd876d-qvsgq to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-8862aa-55748dd5d8-slvct

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-8862aa-55748dd5d8-slvct to ip-10-0-128-246.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-sbh4k

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-sbh4k to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-869b55-7f5bdf58fd-q7l8v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-869b55-7f5bdf58fd-q7l8v to ip-10-0-128-246.ec2.internal

models-as-a-service

payload-processing-external-model-78bf69cc96-bscgp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-78bf69cc96-bscgp to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-2820d9-787bf5fb78-bh47p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2820d9-787bf5fb78-bh47p to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1aa59a-5f69877548-fppdt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1aa59a-5f69877548-fppdt to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-0cc6b1-58d46575d-ww7q2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-0cc6b1-58d46575d-ww7q2 to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-j8v2w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-j8v2w to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-6babca-6dc6645cb4-jw8l5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-6babca-6dc6645cb4-jw8l5 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-6018b4-f55df5fb8-4gsb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-6018b4-f55df5fb8-4gsb2 to ip-10-0-128-246.ec2.internal

models-as-a-service

payload-processing-external-model-7d48d4766c-jkhqb

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7d48d4766c-jkhqb to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-39c99d-57d5954c5b-cv4v2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-39c99d-57d5954c5b-cv4v2 to ip-10-0-128-246.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-9hlhg

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-9hlhg to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb-x5t46

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb-x5t46 to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-8dc43c-5c757b7f8b-hpdrl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-8dc43c-5c757b7f8b-hpdrl to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7 to ip-10-0-128-246.ec2.internal

models-as-a-service

payload-processing-external-model-7d48d4766c-p8l8h

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7d48d4766c-p8l8h to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78 to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp to ip-10-0-133-124.ec2.internal

openshift-ingress

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t to ip-10-0-128-246.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b33a49-6d58bbc64d-49fnt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b33a49-6d58bbc64d-49fnt to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-de14f2-66c68cfd8-z94hs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-de14f2-66c68cfd8-z94hs to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-autores-1e0b31-786cbfd95b-cf8sp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-1e0b31-786cbfd95b-cf8sp to ip-10-0-133-124.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-fm7rx

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-fm7rx to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-derive-ba56e909-6f5476fdc4-vmz9q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ba56e909-6f5476fdc4-vmz9q to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg to ip-10-0-138-176.ec2.internal

openshift-ingress

e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr to ip-10-0-128-246.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-160bf8-857d864c68-p4svr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-160bf8-857d864c68-p4svr to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-1c4bcd-55d686745d-4hhzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-1c4bcd-55d686745d-4hhzp to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-hz7nk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-hz7nk to ip-10-0-138-176.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-713dc8-7d557467f6-5nq4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-713dc8-7d557467f6-5nq4t to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-861bb3-589555cc9b-k659d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-861bb3-589555cc9b-k659d to ip-10-0-128-246.ec2.internal

opendatahub

ai-gateway-controller-b665f6876-csbcr

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-b665f6876-csbcr to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-d1a330-86c85f76d-mhswn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d1a330-86c85f76d-mhswn to ip-10-0-133-124.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-38e0db-674844768b-xkbkd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-38e0db-674844768b-xkbkd to ip-10-0-128-246.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-ff9667845 from 0 to 1

openshift-ingress

replicaset-controller

router-default-ff9667845

SuccessfulCreate

Created pod: router-default-ff9667845-fjrpd

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-ff9667845-fjrpd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-ff9667845-fjrpd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-ff9667845-fjrpd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-ff9667845-fjrpd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-ff9667845-fjrpd

Started

Container started

openshift-ingress

kubelet

router-default-ff9667845-fjrpd

Created

Container created

openshift-ingress

kubelet

router-default-ff9667845-fjrpd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-ff9667845-fjrpd

AddedInterface

Add eth0 [10.133.0.12/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-57kj9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-57kj9

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-57kj9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-57kj9

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-57kj9

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-57kj9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.617s (2.617s including waiting). Image size: 185476477 bytes.

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-76597d6855 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-57kj9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-57kj9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-77d8c79567

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-77d8c79567-5b95c

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-x2rr2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-x2rr2

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-77d8c79567 from 0 to 1

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-77d8c79567-5b95c

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-77d8c79567-5b95c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.916s (9.916s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-77d8c79567-5b95c

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-77d8c79567-5b95c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.909s (9.909s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-77d8c79567-5b95c

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-dv6zs

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dv6zs

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-dv6zs

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dv6zs

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.343s (2.343s including waiting). Image size: 177967631 bytes.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dv6zs_2b01674f-cea6-448b-872c-4091ab1432c6

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-dv6zs_2b01674f-cea6-448b-872c-4091ab1432c6 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-v4fq8

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-v4fq8

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-9hlhg

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-v4fq8

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-9hlhg

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9hlhg

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-v4fq8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.636s (1.636s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-v4fq8

Created

Container created

kuadrant-system

dns-operator-controller-manager-8557cbdb84-v4fq8_dce1bae3-4bd7-45bd-b61d-8d30aa6d62d0

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-v4fq8_dce1bae3-4bd7-45bd-b61d-8d30aa6d62d0 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-v4fq8

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9hlhg

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.643s (2.643s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9hlhg

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9hlhg

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-k8hhs

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-9hlhg_0954d49f-1084-4538-86ad-c8294506add7 became leader

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-k8hhs

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-k8hhs

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-k8hhs

Started

Container started

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-k8hhs

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-k8hhs

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.228s (1.228s including waiting). Image size: 167738465 bytes.

kuadrant-system

authorino-operator-7b7bb4bc77-k8hhs_cbcc2cb4-89cd-4990-89b0-cb1353ca3e1f

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-k8hhs_cbcc2cb4-89cd-4990-89b0-cb1353ca3e1f became leader

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-58c455bdd6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-58c455bdd6-7g2mr

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-58c455bdd6 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-58c455bdd6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-58c455bdd6-cd8zt

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-58c455bdd6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-58c455bdd6-nh2r9

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.851s (2.851s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.008s (3.008s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.875s (2.875s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 353ms (353ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-nh2r9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 276ms (276ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-7g2mr

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 380ms (380ms including waiting). Image size: 273709574 bytes.

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-bsck5

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

opendatahub-operator-controller-manager-58c455bdd6-7g2mr_e31e1ed0-1acf-4dab-b36f-fd7a358f68ef

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-58c455bdd6-7g2mr_e31e1ed0-1acf-4dab-b36f-fd7a358f68ef became leader

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-bsck5

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-58c455bdd6-cd8zt

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-bsck5

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-bsck5

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-bsck5

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-bsck5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.675s (4.675s including waiting). Image size: 424244516 bytes.
(x6)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-ghw27

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-bsck5_0b2ac056-b288-4365-ae97-f2d6534c49fb

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-bsck5_0b2ac056-b288-4365-ae97-f2d6534c49fb became leader

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-ghw27

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ghw27

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dhkgf

FailedMount

MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-dhkgf

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-dhkgf

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dhkgf

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ghw27

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ghw27

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ghw27

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.888s (2.888s including waiting). Image size: 309650901 bytes.
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-6mt6k

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-6mt6k

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-6mt6k

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-6mt6k

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-6mt6k

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dhkgf

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dhkgf

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dhkgf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.381s (4.381s including waiting). Image size: 342538866 bytes.

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-h2877

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-t2654

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

cert-manager

kubelet

cert-manager-597b95cb84-t2654

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-t2654

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-h2877

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-t2654

Created

Container created

cert-manager

multus

cert-manager-597b95cb84-t2654

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-bsck5

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-bsck5

Killing

Stopping container manager

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6545b48489hbqng

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7ffc6d98d7

SuccessfulCreate

Created pod: kube-auth-proxy-7ffc6d98d7-pkgv6

openshift-ingress

replicaset-controller

kube-auth-proxy-7ffc6d98d7

SuccessfulCreate

Created pod: kube-auth-proxy-7ffc6d98d7-wrwtb

openshift-ingress

kubelet

kube-auth-proxy-7ffc6d98d7-wrwtb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-7ffc6d98d7-wrwtb

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7ffc6d98d7-pkgv6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

multus

kube-auth-proxy-7ffc6d98d7-pkgv6

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6545b48489 from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6545b48489

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6545b48489hbqng

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7ffc6d98d7 from 0 to 2

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6545b48489hbqng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6545b48489hbqng

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6545b48489hbqng

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-7ffc6d98d7-pkgv6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.219s (2.219s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7ffc6d98d7-pkgv6

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7ffc6d98d7-pkgv6

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7ffc6d98d7-wrwtb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.381s (2.381s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7ffc6d98d7-wrwtb

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7ffc6d98d7-wrwtb

Started

Container started

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-nxg2g

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-nxg2g

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-nxg2g

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-nxg2g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.243s (2.243s including waiting). Image size: 195729000 bytes.

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-xtpvs"

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-g8vhm"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-84f5bbc5c6

SuccessfulCreate

Created pod: jobset-controller-manager-84f5bbc5c6-6rr5p

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-84f5bbc5c6 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

kubelet

jobset-controller-manager-84f5bbc5c6-6rr5p

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-84f5bbc5c6-6rr5p

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-84f5bbc5c6-6rr5p

Started

Container started

openshift-jobset-operator

jobset-controller-manager-84f5bbc5c6-6rr5p_af36e279-cdd5-482c-8e5f-223f95146408

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-84f5bbc5c6-6rr5p_af36e279-cdd5-482c-8e5f-223f95146408 became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-84f5bbc5c6-6rr5p

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-84f5bbc5c6-6rr5p

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.925s (2.925s including waiting). Image size: 182184678 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-h2877_d792c19d-7a9a-43c9-9789-cbe742eb0a90

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-h2877_d792c19d-7a9a-43c9-9789-cbe742eb0a90 became leader

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-8bfcq

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

multus

limitador-limitador-74dfcfb894-8bfcq

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-tf6wx

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-8bfcq

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-8bfcq

Created

Container created

kuadrant-system

multus

limitador-limitador-7c9b87d574-rlk29

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-rlk29

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-8bfcq

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-tf6wx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-tf6wx

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-h44fj

kuadrant-system

kubelet

authorino-56c6c9ddd5-h44fj

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-h44fj

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-8bfcq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.207s (1.207s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-rlk29

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

authorino-57f7f8659f-tf6wx

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-tf6wx

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-tf6wx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.477s (1.477s including waiting). Image size: 204096810 bytes.

opendatahub

kserve-module-controller-manager-7566cf5fc8-nxg2g_55806a45-784f-4bdf-95aa-ddb9c9999d07

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-nxg2g_55806a45-784f-4bdf-95aa-ddb9c9999d07 became leader

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-tf6wx

kuadrant-system

kubelet

authorino-56c6c9ddd5-h44fj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.553s (2.553s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-rlk29

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-rlk29

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.54s (2.54s including waiting). Image size: 133379307 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-rlk29

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-tf6wx

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-56c6c9ddd5-h44fj

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-h44fj

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-8bfcq

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-8bfcq

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-76f74769d4 from 0 to 1

opendatahub

replicaset-controller

maas-controller-76f74769d4

SuccessfulCreate

Created pod: maas-controller-76f74769d4-kf4sm

opendatahub

replicaset-controller

maas-controller-67cc46c64

SuccessfulCreate

Created pod: maas-controller-67cc46c64-66wvf

opendatahub

kubelet

maas-controller-76f74769d4-kf4sm

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:b5bbc810f3abef8892fd6142b7a8b267f8c83e481135df3981a9bf4c8929e17e"

opendatahub

multus

maas-controller-67cc46c64-66wvf

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

opendatahub

multus

maas-controller-76f74769d4-kf4sm

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-67cc46c64 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-j44sc

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-59st9

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-j44sc

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-9jr6v

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-sbh4k

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j44sc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-nwq95

opendatahub

kubelet

kserve-controller-manager-776cc66d47-sbh4k

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

model-serving-api-75bd89fdfc-59st9

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

odh-model-controller-769875db56-9jr6v

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

model-serving-api-75bd89fdfc-59st9

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-nwq95

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

odh-model-controller-769875db56-9jr6v

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-nwq95

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-sbh4k

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-76f74769d4-kf4sm

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:b5bbc810f3abef8892fd6142b7a8b267f8c83e481135df3981a9bf4c8929e17e" in 3.301s (3.301s including waiting). Image size: 200057363 bytes.

opendatahub

kubelet

maas-controller-76f74769d4-kf4sm

Created

Container created

opendatahub

kubelet

maas-controller-76f74769d4-kf4sm

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-nwq95

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-nwq95

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.508s (2.508s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-sbh4k

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-sbh4k

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.312s (2.312s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-sbh4k

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j44sc

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j44sc

Created

Container created

opendatahub

kubelet

maas-controller-67cc46c64-66wvf

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:b5bbc810f3abef8892fd6142b7a8b267f8c83e481135df3981a9bf4c8929e17e" in 3.166s (3.166s including waiting). Image size: 200057363 bytes.

opendatahub

maas-controller-76f74769d4-kf4sm_44a9cd22-6775-434c-bd7e-baa08b2aaade

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-76f74769d4-kf4sm_44a9cd22-6775-434c-bd7e-baa08b2aaade became leader

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j44sc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.869s (2.869s including waiting). Image size: 185476477 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-59st9

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-59st9

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-nwq95

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-59st9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 1.844s (1.844s including waiting). Image size: 184925761 bytes.

opendatahub

odh-model-controller-769875db56-9jr6v_8bd6e264-ba60-4c40-88ec-9b7c8f679e07

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-9jr6v_8bd6e264-ba60-4c40-88ec-9b7c8f679e07 became leader

opendatahub

kubelet

odh-model-controller-769875db56-9jr6v

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-9jr6v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.646s (2.646s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-9jr6v

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j44sc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-j44sc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kserve-controller-manager-776cc66d47-sbh4k_abc90b9b-c524-40f4-90b4-bb4b7cf5e293

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-sbh4k_abc90b9b-c524-40f4-90b4-bb4b7cf5e293 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-nwq95_244c6464-ca48-4e91-a4f3-2d9753d80c7a

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-nwq95_244c6464-ca48-4e91-a4f3-2d9753d80c7a became leader

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-57kj9

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-57kj9

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-7rt9f

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-7rt9f

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-7rt9f

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-76f74769d4 from 1 to 0

opendatahub

kubelet

maas-controller-76f74769d4-kf4sm

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-76f74769d4

SuccessfulDelete

Deleted pod: maas-controller-76f74769d4-kf4sm

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-7rt9f

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.62s (10.62s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-7rt9f

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-7rt9f

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

maas-controller-67cc46c64-66wvf_d23129b8-d6f2-4568-89cb-c32bbae487cd

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-67cc46c64-66wvf_d23129b8-d6f2-4568-89cb-c32bbae487cd became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-fz4zb

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-d4mxd

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-85779f77c6 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-d4mxd

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-fz4zb
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

Started

Container started

kuadrant-system

replicaset-controller

authorino-85779f77c6

SuccessfulCreate

Created pod: authorino-85779f77c6-shks7
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-85779f77c6-shks7

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-85779f77c6-shks7

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-85779f77c6-shks7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 945ms (945ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-h44fj

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-h44fj

kuadrant-system

kubelet

authorino-85779f77c6-shks7

Created

Container created

kuadrant-system

kubelet

authorino-85779f77c6-shks7

Started

Container started
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

ProbeError

Startup probe error: Get "http://10.134.0.23:15021/healthz/ready": dial tcp 10.134.0.23:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

Unhealthy

Startup probe failed: Get "http://10.134.0.23:15021/healthz/ready": dial tcp 10.134.0.23:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-jzvfr

opendatahub

multus

llmisvc-controller-manager-6466c554d8-jzvfr

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-jzvfr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 324ms (324ms including waiting). Image size: 235100981 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-nwq95

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-nwq95

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-fm7rx

opendatahub

kubelet

ai-gateway-controller-7d85675f98-fm7rx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-fm7rx

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-fm7rx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.387s (2.387s including waiting). Image size: 183926184 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-fm7rx

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-fm7rx

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-fm7rx_58be3036-aad9-441d-92f7-36b15ac05318

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-fm7rx_58be3036-aad9-441d-92f7-36b15ac05318 became leader
(x6)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-97rs5

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-6c557

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6c557

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5f78687d5b-97rs5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-5f78687d5b-97rs5

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-6c557

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6c557

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6c557

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.346s (2.346s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-97rs5

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-97rs5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.311s (2.311s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6c557

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-97rs5

Started

Container started

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-b665f6876 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-b665f6876

SuccessfulCreate

Created pod: ai-gateway-controller-b665f6876-csbcr

opendatahub

kubelet

ai-gateway-controller-b665f6876-csbcr

Created

Container created

opendatahub

kubelet

ai-gateway-controller-b665f6876-csbcr

Started

Container started

opendatahub

kubelet

ai-gateway-controller-b665f6876-csbcr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 289ms (289ms including waiting). Image size: 183926184 bytes.

opendatahub

kubelet

ai-gateway-controller-b665f6876-csbcr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-b665f6876-csbcr

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

opendatahub

llmisvc-controller-manager-6466c554d8-jzvfr_0ae0eeea-28f2-44ee-b4b0-cb0aa00ea3fc

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-jzvfr_0ae0eeea-28f2-44ee-b4b0-cb0aa00ea3fc became leader

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-fm7rx

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-fm7rx

Killing

Stopping container manager

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-bx4v6

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-bx4v6

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-bx4v6

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-bx4v6

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-bx4v6

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1s (1s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-bx4v6

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-dctgm

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-dctgm

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-dctgm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-dctgm

Created

Container created

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-7s88v

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-dctgm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.157s (1.158s including waiting). Image size: 98346788 bytes.

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-dctgm

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-7s88v

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7s88v

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7s88v

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 218ms (218ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7s88v

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7s88v

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-nscmh

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-nscmh

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-nscmh

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-nscmh

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-nscmh

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 188ms (188ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-nscmh

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8clmp5

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8clmp5

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8clmp5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8clmp5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 177ms (177ms including waiting). Image size: 98346788 bytes.

opendatahub

ai-gateway-controller-b665f6876-csbcr_63447ea2-b62c-4e9e-9893-9ae7c32c4a20

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-b665f6876-csbcr_63447ea2-b62c-4e9e-9893-9ae7c32c4a20 became leader

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8clmp5

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8clmp5

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qq7fh

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-qq7fh

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-qq7fh

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qq7fh

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qq7fh

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qq7fh

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.688s (1.688s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-kq2gj

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kq2gj

Created

Container created

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-kq2gj

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kq2gj

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kq2gj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 200ms (200ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kq2gj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.292s (1.292s including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-76597d6855 from 1 to 4

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-vlm9c

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-w98z7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-6qqzg

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-vlm9c

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w98z7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-vlm9c

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-6qqzg

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-vlm9c

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-w98z7

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-vlm9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-6qqzg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

kuadrant-system

replicaset-controller

authorino-5748484d8c

SuccessfulCreate

Created pod: authorino-5748484d8c-wtztm

kuadrant-system

multus

authorino-5748484d8c-wtztm

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5748484d8c-wtztm

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-5748484d8c-wtztm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 819ms (819ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5748484d8c-wtztm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w98z7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-6qqzg

Started

Container started

kuadrant-system

kubelet

authorino-5748484d8c-wtztm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-6qqzg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-6qqzg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.636s (2.636s including waiting). Image size: 183555333 bytes.

kuadrant-system

kubelet

authorino-85779f77c6-shks7

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-85779f77c6

SuccessfulDelete

Deleted pod: authorino-85779f77c6-shks7
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-85779f77c6 from 1 to 0

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w98z7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.635s (2.635s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w98z7

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-vlm9c

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-vlm9c

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w98z7

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w98z7

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-6qqzg

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-6qqzg

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-xkvhq

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-v7b8p

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w8sfs

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-w8sfs

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-v7b8p

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-v7b8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-w8sfs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w8sfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-f5f5q

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-xkvhq

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-v7b8p

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w8sfs

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkvhq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-f5f5q

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkvhq

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-f5f5q

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-f5f5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-v7b8p

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkvhq

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-f5f5q

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-v7b8p

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkvhq

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w8sfs

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w8sfs

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-f5f5q

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkvhq

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-f5f5q

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-v7b8p

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-76597d6855 from 8 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wgrr6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wgrr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-wgrr6

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-wgrr6

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wgrr6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wgrr6

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wgrr6

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ait-54599e13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-54599e13-openshift-default-d8998f799 from 0 to 1

openshift-ingress

multus

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-54599e13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-54599e13

openshift-ingress

gateway_labeler_controller

e2e-migrate-57bf5177-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-57bf5177-gw

openshift-ingress

replicaset-controller

e2e-ait-594f46d3-openshift-default-7b6784c8cf

SuccessfulCreate

Created pod: e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

openshift-ingress

replicaset-controller

e2e-ait-54599e13-openshift-default-d8998f799

SuccessfulCreate

Created pod: e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

openshift-ingress

deployment-controller

e2e-ait-594f46d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-594f46d3-openshift-default-7b6784c8cf from 0 to 1

openshift-ingress

deployment-controller

e2e-migrate-57bf5177-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc from 0 to 1

openshift-ingress

multus

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-594f46d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-594f46d3

openshift-ingress

replicaset-controller

e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc

SuccessfulCreate

Created pod: e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h

openshift-ingress

gateway_labeler_controller

e2e-ait-a521cf49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a521cf49

openshift-ingress

deployment-controller

e2e-ait-a521cf49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a521cf49-openshift-default-d59b5bdbc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a521cf49-openshift-default-d59b5bdbc

SuccessfulCreate

Created pod: e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

openshift-ingress

multus

e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-57bf5177

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-57bf5177-7879c68c96 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-57bf5177

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-xw6rx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-57bf5177-7879c68c96

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-57bf5177-7879c68c96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-57bf5177: serviceaccount "payload-processing-e2e-migrate-57bf5177" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-57bf5177: serviceaccount "payload-processing-e2e-migrate-57bf5177" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-xw6rx

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-57bf5177-7879c68c96

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-57bf5177-7879c68c96-896r4

openshift-ingress

multus

payload-processing-e2e-migrate-57bf5177-7879c68c96-896r4

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-57bf5177-7879c68c96-896r4

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-xw6rx

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-594f46d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-594f46d3-9c97b6f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-594f46d3-9c97b6f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-8f6d8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-594f46d3-9c97b6f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-594f46d3: serviceaccount "payload-processing-e2e-ait-594f46d3" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-594f46d3-86dd96cf4d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-594f46d3-86dd96cf4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-594f46d3: serviceaccount "payload-processing-e2e-ait-594f46d3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-594f46d3-86dd96cf4d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-594f46d3-86dd96cf4d-vpwfb

openshift-ingress

deployment-controller

payload-processing-e2e-ait-594f46d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-594f46d3-86dd96cf4d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-8f6d8

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-54599e13-69cdd8dfb

SuccessfulCreate

Created pod: payload-processing-e2e-ait-54599e13-69cdd8dfb-fnppd
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-54599e13-69cdd8dfb

FailedCreate

Error creating: pods "payload-processing-e2e-ait-54599e13-69cdd8dfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54599e13: serviceaccount "payload-processing-e2e-ait-54599e13" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-54599e13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-54599e13-69cdd8dfb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-594f46d3-86dd96cf4d-vpwfb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-8f6d8

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-54599e13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-54599e13-9fdd4c687 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-54599e13-9fdd4c687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-54599e13-9fdd4c687-9dncf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-54599e13-9fdd4c687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-54599e13-9fdd4c687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54599e13: serviceaccount "payload-processing-e2e-ait-54599e13" not found

openshift-ingress

multus

payload-processing-e2e-ait-594f46d3-86dd96cf4d-vpwfb

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a521cf49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a521cf49-6ccf69fbd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-54599e13-69cdd8dfb-fnppd

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54599e13-9fdd4c687-9dncf

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-m9gg7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a521cf49: serviceaccount "payload-processing-e2e-ait-a521cf49" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-54599e13-9fdd4c687-9dncf

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a521cf49-6ccf69fbd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a521cf49-6ccf69fbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a521cf49: serviceaccount "payload-processing-e2e-ait-a521cf49" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a521cf49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a521cf49-6ccf69fbd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a521cf49-6ccf69fbd-bvmjm

openshift-ingress

multus

payload-processing-e2e-ait-54599e13-69cdd8dfb-fnppd

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-a521cf49-6ccf69fbd-bvmjm

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-m9gg7

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-m9gg7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-a521cf49-6ccf69fbd-bvmjm

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54599e13-9fdd4c687-9dncf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-54599e13-69cdd8dfb-fnppd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.024s (3.024s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-m9gg7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-m9gg7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-594f46d3-86dd96cf4d-vpwfb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-m9gg7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.56s (2.56s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-54599e13-69cdd8dfb-fnppd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-57bf5177-7879c68c96-896r4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.513s (5.513s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-594f46d3-86dd96cf4d-vpwfb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-57bf5177-7879c68c96-896r4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-57bf5177-7879c68c96-896r4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-54599e13-69cdd8dfb-fnppd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54599e13-9fdd4c687-9dncf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54599e13-9fdd4c687-9dncf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.761s (2.761s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-594f46d3-86dd96cf4d-vpwfb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.748s (3.748s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-a521cf49-6ccf69fbd-bvmjm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.762s (2.762s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-a521cf49-6ccf69fbd-bvmjm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-a521cf49-6ccf69fbd-bvmjm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-xw6rx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.659s (5.659s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-xw6rx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-xw6rx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-8f6d8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.697s (4.697s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-8f6d8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-8f6d8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-derive-ba56e909

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ba56e909

openshift-ingress

deployment-controller

e2e-derive-ba56e909-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ba56e909-openshift-default-5f6986b645 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-ba56e909-openshift-default-5f6986b645

SuccessfulCreate

Created pod: e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9

openshift-ingress

multus

e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ba56e909-c84888fc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ba56e909-c84888fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ba56e909: serviceaccount "payload-processing-e2e-derive-ba56e909" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ba56e909-c84888fc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ba56e909-c84888fc5-mm82n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ba56e909

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ba56e909-c84888fc5 from 0 to 1
(x4)

openshift-ingress

kubelet

e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ba56e909-6f5476fdc4

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ba56e909-6f5476fdc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ba56e909: serviceaccount "payload-processing-e2e-derive-ba56e909" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ba56e909-6f5476fdc4

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ba56e909-6f5476fdc4-vmz9q

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ba56e909

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ba56e909-6f5476fdc4 from 0 to 1
(x4)

openshift-ingress

kubelet

e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-ba56e909-6f5476fdc4-vmz9q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-ba56e909-6f5476fdc4-vmz9q

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-ba56e909-6f5476fdc4-vmz9q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ba56e909-c84888fc5-mm82n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ba56e909-c84888fc5-mm82n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-ba56e909-6f5476fdc4-vmz9q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ba56e909-c84888fc5-mm82n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-ba56e909-c84888fc5-mm82n

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-594f46d3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-594f46d3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a521cf49-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a521cf49-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": read tcp 10.132.0.2:49228->10.132.0.44:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

Started

Container started

openshift-ingress

kubelet

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": read tcp 10.132.0.2:49228->10.132.0.44:15021: read: connection reset by peer body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a521cf49-7f9d8dc77f-m9gg7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a521cf49-6ccf69fbd-bvmjm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-594f46d3-86dd96cf4d-vpwfb

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-594f46d3-9c97b6f9-8f6d8

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-921450

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-921450
(x2)

openshift-ingress

kubelet

e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9

Created

Container created

openshift-ingress

kubelet

e2e-ait-594f46d3-openshift-default-7b6784c8cf-tcwsw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-45dc34

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-45dc34

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-57bf5177-5f6f57f4f5-xw6rx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-57bf5177-7879c68c96-896r4

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-54599e13-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-57bf5177-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-57bf5177-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-54599e13-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-a521cf49-openshift-default-d59b5bdbc-nlz9x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ba56e909-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-xs76b

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-921450

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-921450-8d6546c9b from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ba56e909-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-921450-8d6546c9b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-921450-8d6546c9b-5pxxc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-921450

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-921450: serviceaccount "payload-processing-e2e-worker-w0-921450" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-921450-8d6546c9b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-921450-8d6546c9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-921450: serviceaccount "payload-processing-e2e-worker-w0-921450" not found

openshift-ingress

kubelet

e2e-migrate-57bf5177-gw-openshift-default-dfdd4fc-5cl7h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-921450-8d6546c9b-5pxxc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-921450-8d6546c9b-5pxxc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-921450-8d6546c9b-5pxxc

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-xs76b

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-xs76b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-921450-8d6546c9b-5pxxc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-xs76b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-xs76b

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-45dc34: serviceaccount "payload-processing-e2e-worker-w2-45dc34" not found

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-45dc34

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-rqxz2
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-45dc34-79f9556b56

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-45dc34-79f9556b56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-45dc34: serviceaccount "payload-processing-e2e-worker-w2-45dc34" not found

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-de7e3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-de7e3a

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-45dc34-79f9556b56

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-45dc34-79f9556b56-st7qr

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-45dc34

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-45dc34-79f9556b56 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ba56e909-c84888fc5-mm82n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-rqxz2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-45dc34-79f9556b56-st7qr

Created

Container created

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-45dc34-79f9556b56-st7qr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-rqxz2

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-rqxz2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-rqxz2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-ba56e909-6f5476fdc4-vmz9q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-45dc34-79f9556b56-st7qr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-45dc34-79f9556b56-st7qr

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54599e13-9fdd4c687-9dncf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-54599e13-69cdd8dfb-fnppd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-ba56e909-openshift-default-5f6986b645-6rzl9

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-de7e3a: serviceaccount "payload-processing-e2e-worker-w3-de7e3a" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-de7e3a: serviceaccount "payload-processing-e2e-worker-w3-de7e3a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-99nqx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-de7e3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-380c08

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-380c08

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-de7e3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-mlkk9

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-99nqx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-99nqx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-mlkk9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-mlkk9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-mlkk9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-mlkk9

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-99nqx

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-99nqx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-fe1374

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-fe1374

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-54599e13-openshift-default-d8998f799-mwtl5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-380c08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-380c08-67478544f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-380c08-67478544f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-380c08-67478544f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-380c08: serviceaccount "payload-processing-e2e-worker-w1-380c08" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-380c08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-380c08-65f99966c6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-380c08-65f99966c6

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-380c08-65f99966c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-380c08: serviceaccount "payload-processing-e2e-worker-w1-380c08" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-380c08-65f99966c6-8p2v9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-380c08-67478544f9-4pdqp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-380c08-65f99966c6-8p2v9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-380c08-65f99966c6-8p2v9

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-380c08-65f99966c6-8p2v9

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-380c08-65f99966c6

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-380c08-65f99966c6-8p2v9

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-380c08-67478544f9-4pdqp

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-380c08-67478544f9-4pdqp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-380c08-67478544f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-380c08-67478544f9-4pdqp

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-380c08-67478544f9-4pdqp

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-fe1374

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-fe1374-65cf8c997d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-fe1374: serviceaccount "payload-processing-e2e-worker-w4-fe1374" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-bl75c
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-fe1374-65cf8c997d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-fe1374-65cf8c997d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-fe1374: serviceaccount "payload-processing-e2e-worker-w4-fe1374" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-fe1374-65cf8c997d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-fe1374-65cf8c997d-5j2vz

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-bl75c

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-fe1374

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fe1374-65cf8c997d-5j2vz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-bl75c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-bl75c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-bl75c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fe1374-65cf8c997d-5j2vz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-fe1374-65cf8c997d-5j2vz

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fe1374-65cf8c997d-5j2vz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

Created

Container created

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 4 to 8

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

Started

Container started

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

Started

Container started

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

Started

Container started

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 1 to 2

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-76597d6855 from 9 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-xkvhq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkvhq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-76597d6855 from 8 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-6qqzg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-6qqzg

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

Created

Container created

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

Created

Container created

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

Created

Container created

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

Created

Container created

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 4 to 7

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

Created

Container created

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

Started

Container started

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 4 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

Started

Container started

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kq2gj

Unhealthy

Readiness probe failed: Get "https://10.132.0.40:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

ProbeError

Readiness probe error: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

Unhealthy

Readiness probe failed: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-dctgm

Unhealthy

Readiness probe failed: Get "https://10.134.0.42:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 5 to 9

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 4 to 5

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

Started

Container started

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

Created

Container created

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

ProbeError

Readiness probe error: Get "http://10.134.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

Unhealthy

Readiness probe failed: Get "http://10.134.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-f5f5q

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-f5f5q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

Unhealthy

Liveness probe failed: Get "https://10.133.0.39:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-f5f5q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-f5f5q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

gateway_labeler_controller

e2e-api-a-4b709d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4b709d

openshift-ingress

gateway_labeler_controller

e2e-mt-0c6613ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-0c6613ea

openshift-ingress

deployment-controller

e2e-mt-0c6613ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-0c6613ea-openshift-default-6684df784f from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-0c6613ea-openshift-default-6684df784f

SuccessfulCreate

Created pod: e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 9 to 10

openshift-ingress

replicaset-controller

e2e-api-a-4b709d-openshift-default-54cc45486f

SuccessfulCreate

Created pod: e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

openshift-ingress

deployment-controller

e2e-api-a-4b709d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4b709d-openshift-default-54cc45486f from 0 to 1

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 5 to 6

openshift-ingress

multus

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

Created

Container created

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

Unhealthy

Liveness probe failed: Get "https://10.133.0.39:8000/health": context deadline exceeded

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-vlm9c

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

Unhealthy

Readiness probe failed: Get "https://10.133.0.39:8000/ready": context deadline exceeded

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w8sfs

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w8sfs

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-vlm9c

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0c6613ea-86469f66f4

SuccessfulCreate

Created pod: payload-processing-e2e-mt-0c6613ea-86469f66f4-2zwb7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-v7b8p

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wgrr6

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-5jbdk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0c6613ea-86469f66f4

FailedCreate

Error creating: pods "payload-processing-e2e-mt-0c6613ea-86469f66f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0c6613ea: serviceaccount "payload-processing-e2e-mt-0c6613ea" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ghw27

Unhealthy

Liveness probe failed: Get "http://10.132.0.25:6080/livez": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0c6613ea: serviceaccount "payload-processing-e2e-mt-0c6613ea" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-0c6613ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-0c6613ea-7978559fc9 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wgrr6

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-mt-0c6613ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-0c6613ea-86469f66f4 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-v7b8p

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-5jbdk

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-5jbdk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-0c6613ea-86469f66f4-2zwb7

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4b709d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4b709d-7d96656586 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4b709d-5df8f677bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4b709d-5df8f677bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4b709d: serviceaccount "payload-processing-e2e-api-a-4b709d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4b709d-5df8f677bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4b709d-5df8f677bc-b4srr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4b709d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4b709d-5df8f677bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4b709d-7d96656586

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4b709d-7d96656586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4b709d: serviceaccount "payload-processing-e2e-api-a-4b709d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4b709d-7d96656586

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4b709d-7d96656586-hxnbn

openshift-ingress

kubelet

payload-processing-e2e-mt-0c6613ea-86469f66f4-2zwb7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-0c6613ea-86469f66f4-2zwb7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-5jbdk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-5jbdk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-0c6613ea-86469f66f4-2zwb7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-4b709d-7d96656586-hxnbn

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b709d-7d96656586-hxnbn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b709d-7d96656586-hxnbn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b709d-7d96656586-hxnbn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x10)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b709d-5df8f677bc-b4srr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b709d-5df8f677bc-b4srr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4b709d-5df8f677bc-b4srr

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b709d-5df8f677bc-b4srr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-4n5fx

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-fkxzr

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-9rhcl

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-76597d6855-9rhcl

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-xhh6v

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-76597d6855 from 6 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xhh6v

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-9rhcl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-fkxzr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-fkxzr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-fkxzr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-4n5fx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-4n5fx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-9rhcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-9rhcl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-4n5fx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xhh6v

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xhh6v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 6 to 9

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

Started

Container started

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

Created

Container created

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-4n5fx

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-4n5fx

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-9rhcl

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-9rhcl

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xhh6v

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xhh6v

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-fkxzr

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-fkxzr

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-d74mc

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-d74mc

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2
(x8)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-d74mc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-d74mc

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-d74mc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

ProbeError

Readiness probe error: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7dkfn

Unhealthy

Readiness probe failed: Get "https://10.133.0.39:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

ProbeError

Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

Unhealthy

Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-api-a-f15587-openshift-default-8554849b4f

SuccessfulCreate

Created pod: e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2

openshift-ingress

deployment-controller

e2e-api-a-f15587-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f15587-openshift-default-8554849b4f from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-0c6613ea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-0c6613ea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-a-f15587

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f15587

openshift-ingress

multus

e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-b33a49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b33a49-openshift-default-5cf545bb67 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-b33a49-openshift-default-5cf545bb67

SuccessfulCreate

Created pod: e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj

openshift-ingress

gateway_labeler_controller

e2e-api-b-b33a49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b33a49

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f15587

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f15587-7cccff6f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f15587-7cccff6f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f15587-7cccff6f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f15587: serviceaccount "payload-processing-e2e-api-a-f15587" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f15587

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f15587-674b5c966 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f15587-7cccff6f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f15587-7cccff6f5-89g5c
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f15587-674b5c966

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f15587-674b5c966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f15587: serviceaccount "payload-processing-e2e-api-a-f15587" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f15587-674b5c966

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f15587-674b5c966-d8pd8

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f15587-7cccff6f5-89g5c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f15587-7cccff6f5-89g5c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-f15587-674b5c966-d8pd8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-f15587-674b5c966-d8pd8

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-f15587-674b5c966-d8pd8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f15587-674b5c966-d8pd8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f15587-7cccff6f5-89g5c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f15587-7cccff6f5-89g5c

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b33a49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b33a49-6d58bbc64d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b33a49-6f47646bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b33a49-6f47646bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b33a49: serviceaccount "payload-processing-e2e-api-b-b33a49" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b33a49-6f47646bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b33a49-6f47646bf9-lpsfd
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b33a49-6d58bbc64d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b33a49-6d58bbc64d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b33a49: serviceaccount "payload-processing-e2e-api-b-b33a49" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b33a49-6d58bbc64d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b33a49-6d58bbc64d-49fnt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b33a49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b33a49-6f47646bf9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b33a49-6f47646bf9-lpsfd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b33a49-6f47646bf9-lpsfd

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b33a49-6d58bbc64d-49fnt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-b33a49-6d58bbc64d-49fnt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b33a49-6f47646bf9-lpsfd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b33a49-6f47646bf9-lpsfd

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-b33a49-6d58bbc64d-49fnt

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b33a49-6d58bbc64d-49fnt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

Unhealthy

Readiness probe failed: Get "http://10.132.0.105:15021/healthz/ready": read tcp 10.132.0.2:44850->10.132.0.105:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

Created

Container created

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

ProbeError

Readiness probe error: Get "http://10.132.0.105:15021/healthz/ready": read tcp 10.132.0.2:44850->10.132.0.105:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4b709d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4b709d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-0c6613ea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b33a49-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b33a49-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-0c6613ea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-api-b-8dc43c-openshift-default-5cb789c645

SuccessfulCreate

Created pod: e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

openshift-ingress

gateway_labeler_controller

e2e-api-b-8dc43c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-8dc43c

openshift-ingress

deployment-controller

e2e-api-b-8dc43c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-8dc43c-openshift-default-5cb789c645 from 0 to 1

openshift-ingress

multus

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8dc43c-5c757b7f8b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-8dc43c-5c757b7f8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8dc43c: serviceaccount "payload-processing-e2e-api-b-8dc43c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8dc43c-5c757b7f8b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-8dc43c-5c757b7f8b-hpdrl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8dc43c: serviceaccount "payload-processing-e2e-api-b-8dc43c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9-m89jr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-8dc43c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-8dc43c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-8dc43c-5c757b7f8b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-8dc43c-5c757b7f8b-hpdrl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-8dc43c-5c757b7f8b-hpdrl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9-m89jr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9-m89jr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9-m89jr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-8dc43c-5c757b7f8b-hpdrl

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9-m89jr

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-8dc43c-5c757b7f8b-hpdrl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4b709d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4b709d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f15587-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f15587-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-f257t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-0c6613ea-openshift-default-6684df784f-f257t

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-0c6613ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-0c6613ea-openshift-default-6684df784f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-0c6613ea-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-0c6613ea-openshift-default-6684df784f

SuccessfulCreate

Created pod: e2e-mt-0c6613ea-openshift-default-6684df784f-f257t

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-f257t

Created

Container created

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-f257t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b709d-7d96656586-hxnbn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b709d-5df8f677bc-b4srr

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-f257t

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-f257t

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8dc43c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8dc43c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f15587-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f15587-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b33a49-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b33a49-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7619-cc48c5

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7619-cc48c5

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7619-cc48c5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f15587-674b5c966-d8pd8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-4b709d-openshift-default-54cc45486f-rqjh2

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7619-cc48c5

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.07s (2.07s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7619-cc48c5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f15587-7cccff6f5-89g5c

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-7619-cc48c5

Killing

Stopping container test-curl-7619-cc48c5
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8dc43c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8dc43c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-b33a49-6d58bbc64d-49fnt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b33a49-6f47646bf9-lpsfd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0c6613ea-86469f66f4-2zwb7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-5jbdk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-f15587-openshift-default-8554849b4f-t4hd2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-5jbdk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-0c6613ea-86469f66f4-2zwb7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-api-b-8dc43c-5c757b7f8b-hpdrl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8dc43c-5bc899bbc9-m89jr

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-a-2ee874

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2ee874

openshift-ingress

deployment-controller

e2e-api-a-2ee874-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2ee874-openshift-default-8457d78d47 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-2ee874-openshift-default-8457d78d47

SuccessfulCreate

Created pod: e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

openshift-ingress

multus

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0c6613ea-86469f66f4

FailedCreate

Error creating: pods "payload-processing-e2e-mt-0c6613ea-86469f66f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0c6613ea: serviceaccount "payload-processing-e2e-mt-0c6613ea" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-0c6613ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-0c6613ea-7978559fc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-0c6613ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-0c6613ea-86469f66f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0c6613ea: serviceaccount "payload-processing-e2e-mt-0c6613ea" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-2csfr

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0c6613ea-86469f66f4

SuccessfulCreate

Created pod: payload-processing-e2e-mt-0c6613ea-86469f66f4-5bklf

openshift-ingress

kubelet

e2e-api-b-b33a49-openshift-default-5cf545bb67-kbrdj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-0c6613ea-86469f66f4-5bklf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-2csfr

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-2csfr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-2csfr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-2csfr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-0c6613ea-86469f66f4-5bklf

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-e9096a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e9096a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e9096a

openshift-ingress

kubelet

payload-processing-e2e-mt-0c6613ea-86469f66f4-5bklf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-0c6613ea-86469f66f4-5bklf

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc

SuccessfulCreate

Created pod: e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f42594

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f42594

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2ee874

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2ee874-5b975bd4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2ee874-5b975bd4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2ee874-5b975bd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2ee874: serviceaccount "payload-processing-e2e-api-a-2ee874" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2ee874-5b975bd4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2ee874-5b975bd4-drq62

openshift-ingress

multus

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7

SuccessfulCreate

Created pod: e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

openshift-ingress

multus

e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2ee874-69fddfb67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2ee874-69fddfb67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2ee874: serviceaccount "payload-processing-e2e-api-a-2ee874" not found

openshift-ingress

deployment-controller

e2e-ipp-a-f42594-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f42594-openshift-default-c8d4dd6d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2ee874-69fddfb67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2ee874-69fddfb67-hscz8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2ee874

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2ee874-69fddfb67 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2ee874-69fddfb67-hscz8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2ee874-69fddfb67-hscz8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-2ee874-5b975bd4-drq62

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2ee874-69fddfb67-hscz8

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-2ee874-5b975bd4-drq62

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-2ee874-5b975bd4-drq62

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2ee874-69fddfb67-hscz8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-2ee874-5b975bd4-drq62

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f42594

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f42594-7c6f78d84 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f42594

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f42594-5669779bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f42594-5669779bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f42594-5669779bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f42594: serviceaccount "payload-processing-e2e-ipp-a-f42594" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f42594-5669779bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f42594-5669779bc-7249d
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f42594-7c6f78d84

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f42594-7c6f78d84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f42594: serviceaccount "payload-processing-e2e-ipp-a-f42594" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f42594-7c6f78d84

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f42594-7c6f78d84-zkpr2

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e9096a-685c586796

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e9096a-685c586796-k9fgv

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f42594-7c6f78d84-zkpr2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f42594-5669779bc-7249d

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f42594-7c6f78d84-zkpr2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f42594-5669779bc-7249d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f42594-7c6f78d84-zkpr2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f42594-5669779bc-7249d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f42594-5669779bc-7249d

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e9096a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-f42594-7c6f78d84-zkpr2

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5-q85dn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e9096a: serviceaccount "payload-processing-e2e-ipp-a-e9096a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e9096a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e9096a-685c586796 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e9096a-685c586796

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e9096a-685c586796-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e9096a: serviceaccount "payload-processing-e2e-ipp-a-e9096a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5-q85dn

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5-q85dn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9096a-685c586796-k9fgv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9096a-685c586796-k9fgv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5-q85dn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5-q85dn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9096a-685c586796-k9fgv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-e9096a-685c586796-k9fgv

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2ee874-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2ee874-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-r4k2t

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-r4k2t

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4k2t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4k2t

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4k2t

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4k2t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.027s (3.027s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4k2t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4k2t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-8dc43c-openshift-default-5cb789c645-bz9k7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-ipp-a-011d6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-011d6f-openshift-default-555c887c5f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-011d6f-openshift-default-555c887c5f

SuccessfulCreate

Created pod: e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-011d6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-011d6f

openshift-ingress

multus

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

opendatahub

multus

test-curl-7619-4e036a

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7619-4e036a

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 657ms (657ms including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7619-4e036a

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7619-4e036a

Created

Container created

opendatahub

kubelet

test-curl-7619-4e036a

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

Created

Container created

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

ProbeError

Readiness probe error: Get "http://10.134.0.109:15021/healthz/ready": read tcp 10.134.0.2:48112->10.134.0.109:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

Unhealthy

Readiness probe failed: Get "http://10.134.0.109:15021/healthz/ready": read tcp 10.134.0.2:48112->10.134.0.109:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f42594-5669779bc-7249d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f42594-7c6f78d84-zkpr2

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f42594-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f42594-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

ProbeError

Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

Unhealthy

Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-de14f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-de14f2

openshift-ingress

deployment-controller

e2e-api-b-de14f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-de14f2-openshift-default-7df9c9ff75 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-de14f2-openshift-default-7df9c9ff75

SuccessfulCreate

Created pod: e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb
(x6)

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-011d6f: serviceaccount "payload-processing-e2e-ipp-a-011d6f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-011d6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-011d6f-6747d9ddd4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-011d6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c-mlnfd

opendatahub

kubelet

test-curl-7619-4e036a

Killing

Stopping container test-curl-7619-4e036a

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-011d6f-6747d9ddd4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-011d6f-6747d9ddd4-bhn8d
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-011d6f-6747d9ddd4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-011d6f-6747d9ddd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-011d6f: serviceaccount "payload-processing-e2e-ipp-a-011d6f" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c-mlnfd

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-011d6f-6747d9ddd4-bhn8d

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c-mlnfd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c-mlnfd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c-mlnfd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-011d6f-6747d9ddd4-bhn8d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-011d6f-6747d9ddd4-bhn8d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-011d6f-6747d9ddd4-bhn8d

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-de14f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-de14f2-66c68cfd8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-de14f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-de14f2-689d7c47c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-de14f2-689d7c47c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-de14f2-689d7c47c5-lnpph

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-de14f2-66c68cfd8

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-de14f2-66c68cfd8-z94hs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-de14f2-66c68cfd8

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-de14f2-66c68cfd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-de14f2: serviceaccount "payload-processing-e2e-api-b-de14f2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-de14f2-689d7c47c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-de14f2-689d7c47c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-de14f2: serviceaccount "payload-processing-e2e-api-b-de14f2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9096a-84c84577c5-q85dn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9096a-685c586796-k9fgv

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-de14f2-689d7c47c5-lnpph

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-de14f2-689d7c47c5-lnpph

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-de14f2-689d7c47c5-lnpph

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-de14f2-689d7c47c5-lnpph

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-de14f2-66c68cfd8-z94hs

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-de14f2-66c68cfd8-z94hs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-de14f2-66c68cfd8-z94hs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-de14f2-66c68cfd8-z94hs

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f42594-87777b966

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f42594-87777b966-2nn2h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f42594

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f42594-6fc446668c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f42594-6fc446668c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-6jr84
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f42594-6fc446668c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f42594: serviceaccount "payload-processing-e2e-ipp-a-f42594" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f42594

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f42594-87777b966 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f42594-87777b966

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f42594-87777b966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f42594: serviceaccount "payload-processing-e2e-ipp-a-f42594" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-6jr84

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-6jr84

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f42594-87777b966-2nn2h

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-f42594-87777b966-2nn2h

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e9096a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e9096a: serviceaccount "payload-processing-e2e-ipp-a-e9096a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-6jr84

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f42594-87777b966-2nn2h

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e9096a: serviceaccount "payload-processing-e2e-ipp-a-e9096a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f42594-87777b966-2nn2h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.354s (1.354s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-6jr84

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.19s (1.19s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-6jr84

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-2kmj8

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f42594-87777b966-2nn2h

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e9096a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-2kmj8

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-zfdxn

openshift-ingress

kubelet

payload-processing-e2e-mt-0c6613ea-86469f66f4-5bklf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-2kmj8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-zfdxn

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-zfdxn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0c6613ea-7978559fc9-2csfr

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-011d6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-011d6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-zfdxn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-zfdxn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-zfdxn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.314s (4.314s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-2kmj8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.475s (4.475s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-2kmj8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-2kmj8

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2ee874-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2ee874-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f42594-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f42594-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9096a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9096a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f

SuccessfulCreate

Created pod: e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f826dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f826dd

openshift-ingress

deployment-controller

e2e-ipp-b-f826dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f826dd-openshift-default-6fc76ff86f from 0 to 1

openshift-ingress

multus

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f826dd-b9f9b8586

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f826dd-b9f9b8586-jjsqm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f826dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f826dd-695db48787 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f826dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f826dd-b9f9b8586 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f826dd-b9f9b8586

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f826dd-b9f9b8586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f826dd: serviceaccount "payload-processing-e2e-ipp-b-f826dd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f826dd-695db48787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f826dd-695db48787-488nc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f826dd-695db48787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f826dd-695db48787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f826dd: serviceaccount "payload-processing-e2e-ipp-b-f826dd" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f826dd-b9f9b8586-jjsqm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f826dd-695db48787-488nc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f826dd-695db48787-488nc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-f826dd-b9f9b8586-jjsqm

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f826dd-695db48787-488nc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f826dd-b9f9b8586-jjsqm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f826dd-695db48787-488nc

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f826dd-b9f9b8586-jjsqm

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 10 to 6

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-h4qff

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-vznqj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-nlwkz

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-xfmwp

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-76135e-openshift-default-fd74fffc5

SuccessfulCreate

Created pod: e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt

openshift-ingress

deployment-controller

e2e-ipp-b-76135e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-76135e-openshift-default-fd74fffc5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-76135e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-76135e
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-de14f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-de14f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-011d6f-7d8df6544c-mlnfd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-011d6f-6747d9ddd4-bhn8d

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-76135e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-76135e-6b67694855 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-76135e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-76135e-759fd4f54d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-76135e-759fd4f54d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-76135e-759fd4f54d-jcj6v
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-76135e-759fd4f54d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-76135e-759fd4f54d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-76135e: serviceaccount "payload-processing-e2e-ipp-b-76135e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-76135e-6b67694855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-76135e-6b67694855-jkbgw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-76135e-6b67694855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-76135e-6b67694855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-76135e: serviceaccount "payload-processing-e2e-ipp-b-76135e" not found

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

ProbeError

Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76135e-6b67694855-jkbgw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-76135e-6b67694855-jkbgw

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-76135e-759fd4f54d-jcj6v

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

Unhealthy

Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76135e-759fd4f54d-jcj6v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76135e-759fd4f54d-jcj6v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76135e-6b67694855-jkbgw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76135e-6b67694855-jkbgw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76135e-759fd4f54d-jcj6v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9096a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9096a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb

Unhealthy

Startup probe failed: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb

ProbeError

Startup probe error: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x2)

opendatahub

kubelet

maas-controller-67cc46c64-66wvf

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-67cc46c64-66wvf

Created

Container created

opendatahub

kubelet

maas-controller-67cc46c64-66wvf

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:b5bbc810f3abef8892fd6142b7a8b267f8c83e481135df3981a9bf4c8929e17e" in 554ms (554ms including waiting). Image size: 200057363 bytes.
(x2)

opendatahub

kubelet

maas-controller-67cc46c64-66wvf

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:b5bbc810f3abef8892fd6142b7a8b267f8c83e481135df3981a9bf4c8929e17e"
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-76135e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-76135e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-de14f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-de14f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

Unhealthy

Readiness probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

ProbeError

Readiness probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-011d6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-011d6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused

opendatahub

maas-controller-67cc46c64-66wvf_e5e06b94-6af2-43e2-8e30-6e9e2d307ce9

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-67cc46c64-66wvf_e5e06b94-6af2-43e2-8e30-6e9e2d307ce9 became leader

openshift-ingress

kubelet

payload-processing-e2e-api-a-2ee874-5b975bd4-drq62

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2ee874-69fddfb67-hscz8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-wgq44

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-0c6613ea-openshift-default-6684df784f-f257t

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 10 to 6

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-zd6pg

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-5gfg7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-zvzft

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 10 to 7

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-g9j6m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-wd789

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rnhxx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-9qrq9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-10f1a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-10f1a3-openshift-default-7ddf867857 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-10f1a3-openshift-default-7ddf867857

SuccessfulCreate

Created pod: e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-wrwbl

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zzc6t

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 10 to 8

openshift-ingress

gateway_labeler_controller

e2e-api-a-10f1a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-10f1a3

openshift-ingress

multus

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f826dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f826dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-10f1a3-d55fc9547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-10f1a3-d55fc9547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-10f1a3: serviceaccount "payload-processing-e2e-api-a-10f1a3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-10f1a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-10f1a3-d55fc9547 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-10f1a3-6f6f779d4b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-10f1a3-6f6f779d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-10f1a3: serviceaccount "payload-processing-e2e-api-a-10f1a3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-10f1a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-10f1a3-6f6f779d4b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-10f1a3-d55fc9547-kj7nd

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-10f1a3-d55fc9547-kj7nd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-10f1a3-6f6f779d4b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-10f1a3-6f6f779d4b-95h9b

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-10f1a3-d55fc9547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-10f1a3-d55fc9547-kj7nd

openshift-ingress

kubelet

payload-processing-e2e-api-a-10f1a3-6f6f779d4b-95h9b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-10f1a3-6f6f779d4b-95h9b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-10f1a3-6f6f779d4b-95h9b

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-10f1a3-d55fc9547-kj7nd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-10f1a3-d55fc9547-kj7nd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-10f1a3-6f6f779d4b-95h9b

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 7 to 6

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-7ws4w

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 8 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-77zft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-th5rw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-85r6x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-2ee874-openshift-default-8457d78d47-lbg4b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-sgtlx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-011d6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-011d6f-cc789d486 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-011d6f-85479995f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-011d6f-85479995f5-54sn4
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-011d6f-85479995f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-011d6f-85479995f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-011d6f: serviceaccount "payload-processing-e2e-ipp-a-011d6f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-011d6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-011d6f-85479995f5 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-011d6f-cc789d486

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-011d6f-cc789d486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-011d6f: serviceaccount "payload-processing-e2e-ipp-a-011d6f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-011d6f-85479995f5-54sn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-011d6f-cc789d486-srcwt

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-011d6f-cc789d486-srcwt

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-011d6f-85479995f5-54sn4

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-011d6f-85479995f5-54sn4

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-011d6f-cc789d486

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-011d6f-cc789d486-srcwt

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-011d6f-cc789d486-srcwt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-011d6f-cc789d486-srcwt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-011d6f-85479995f5-54sn4

Started

Container started

openshift-ingress

kubelet

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

ProbeError

Readiness probe error: Get "http://10.134.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

Unhealthy

Readiness probe failed: Get "http://10.134.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-v9p8r

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-m7qjw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 8 to 6
(x2)

openshift-ingress

kubelet

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-de14f2-689d7c47c5-lnpph

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-de14f2-66c68cfd8-z94hs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f826dd-695db48787-488nc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f826dd-b9f9b8586-jjsqm

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-10f1a3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-10f1a3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-0ac6bb-openshift-default-745b898b59

SuccessfulCreate

Created pod: e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

openshift-ingress

gateway_labeler_controller

e2e-api-b-0ac6bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0ac6bb

openshift-ingress

deployment-controller

e2e-api-b-0ac6bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0ac6bb-openshift-default-745b898b59 from 0 to 1

openshift-ingress

multus

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0ac6bb: serviceaccount "payload-processing-e2e-api-b-0ac6bb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447-5n5xd

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0ac6bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0ac6bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0ac6bb: serviceaccount "payload-processing-e2e-api-b-0ac6bb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447-5n5xd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb-x5t46

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447-5n5xd

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb-x5t46

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb-x5t46

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447-5n5xd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb-x5t46

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447-5n5xd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb-x5t46

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f826dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755-t8pkx

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f826dd-66fc94df7b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f826dd-66fc94df7b-vd626
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f826dd-66fc94df7b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f826dd-66fc94df7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f826dd: serviceaccount "payload-processing-e2e-ipp-b-f826dd" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f826dd: serviceaccount "payload-processing-e2e-ipp-b-f826dd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f826dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f826dd-66fc94df7b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755-t8pkx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f826dd-66fc94df7b-vd626

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755-t8pkx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-f826dd-66fc94df7b-vd626

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755-t8pkx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f826dd-66fc94df7b-vd626

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f826dd-66fc94df7b-vd626

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755-t8pkx

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76135e-759fd4f54d-jcj6v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76135e-6b67694855-jkbgw

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-17df15

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-17df15

openshift-ingress

replicaset-controller

e2e-ipp-b-17df15-openshift-default-7cd5d6b88f

SuccessfulCreate

Created pod: e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn

openshift-ingress

deployment-controller

e2e-ipp-b-17df15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-17df15-openshift-default-7cd5d6b88f from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f42594-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-a-f42594\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-17df15

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-17df15-784cb9f975 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-10f1a3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-api-a-10f1a3\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-17df15

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-17df15-dbdfd998b from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-10f1a3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-api-a-10f1a3\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f42594-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-a-f42594\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-17df15-784cb9f975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-17df15-784cb9f975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-17df15: serviceaccount "payload-processing-e2e-ipp-b-17df15" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-17df15-dbdfd998b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-17df15-dbdfd998b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-17df15: serviceaccount "payload-processing-e2e-ipp-b-17df15" not found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

ComponentUnhealthy

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

multus

payload-processing-e2e-ipp-b-17df15-dbdfd998b-949th

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-17df15-dbdfd998b-949th

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dv6zs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-17df15-784cb9f975-7grmk

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-17df15-dbdfd998b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-17df15-dbdfd998b-949th
(x2)

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dv6zs

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-17df15-784cb9f975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-17df15-784cb9f975-7grmk
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-h2877

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dv6zs

Pulled

Container image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-h2877

Started

Container started
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-h2877

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-76135e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-b-76135e\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-nxg2g

Started

Container started
(x2)

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-nxg2g

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-nxg2g

Pulled

Container image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-17df15-784cb9f975-7grmk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f826dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-b-f826dd\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

NeedsReinstall

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f826dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-b-f826dd\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-17df15-784cb9f975-7grmk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-17df15-dbdfd998b-949th

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-17df15-dbdfd998b-949th

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-76135e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-b-76135e\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-17df15-784cb9f975-7grmk

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-de14f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-api-b-de14f2\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-de14f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-api-b-de14f2\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w3-de7e3a\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w3-de7e3a\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-011d6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-a-011d6f\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-011d6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-a-011d6f\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

e2e-api-b-de14f2-openshift-default-7df9c9ff75-cjbwb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-76135e-5d8b8684b6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-76135e-5d8b8684b6-g4jr8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7-4fqtg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-76135e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-76135e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-76135e-5d8b8684b6 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-76135e-5d8b8684b6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-76135e-5d8b8684b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-76135e: serviceaccount "payload-processing-e2e-ipp-b-76135e" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-76135e: serviceaccount "payload-processing-e2e-ipp-b-76135e" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-76135e-5d8b8684b6-g4jr8

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7-4fqtg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76135e-5d8b8684b6-g4jr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7-4fqtg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76135e-5d8b8684b6-g4jr8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7-4fqtg

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7-4fqtg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76135e-5d8b8684b6-g4jr8

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5

SuccessfulCreate

Created pod: e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

openshift-ingress

multus

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-h2877_a7e48afb-cc42-4d4a-8f34-cfabb38e6e90

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-h2877_a7e48afb-cc42-4d4a-8f34-cfabb38e6e90 became leader

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-a4f3f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-a4f3f0

openshift-ingress

deployment-controller

e2e-praxis-a-a4f3f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a4f3f0-openshift-default-668bf869d5 from 0 to 1

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dv6zs_13c80f2c-abc5-4063-96e3-e31531ac29b8

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-dv6zs_13c80f2c-abc5-4063-96e3-e31531ac29b8 became leader

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Ddata-science-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Ddata-science-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Dopenshift-ai-inference\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Dmaas-default-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Dmaas-default-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Dopenshift-ai-inference\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w1-380c08\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w0-921450\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w1-380c08\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w0-921450\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-a4f3f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-a4f3f0-594b877768 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a4f3f0: serviceaccount "payload-processing-e2e-praxis-a-a4f3f0" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a4f3f0-594b877768

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-a4f3f0-594b877768-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a4f3f0: serviceaccount "payload-processing-e2e-praxis-a-a4f3f0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a4f3f0-594b877768

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-a4f3f0-594b877768-ctrsw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-a4f3f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-7mxbc

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-7mxbc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a4f3f0-594b877768-ctrsw

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-7mxbc

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-a4f3f0-594b877768-ctrsw

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a4f3f0-594b877768-ctrsw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a4f3f0-594b877768-ctrsw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-7mxbc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-7mxbc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w2-45dc34\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w2-45dc34\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9096a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-a-e9096a\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9096a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-a-e9096a\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0ac6bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-api-b-0ac6bb\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-17df15-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-b-17df15\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w4-fe1374\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w4-fe1374\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0ac6bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-api-b-0ac6bb\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

opendatahub

kserve-module-controller-manager-7566cf5fc8-nxg2g_add95e1c-d7a6-46c5-b666-2e94d42db271

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-nxg2g_add95e1c-d7a6-46c5-b666-2e94d42db271 became leader

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-17df15-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-ipp-b-17df15\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

ProbeError

Readiness probe error: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

Unhealthy

Readiness probe failed: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:
(x2)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-jzvfr

Started

Container started
(x2)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-jzvfr

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-jzvfr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 364ms (364ms including waiting). Image size: 235100981 bytes.
(x2)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-jzvfr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-17df15-784cb9f975-7grmk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-17df15-dbdfd998b-949th

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn

Created

Container created

opendatahub

llmisvc-controller-manager-6466c554d8-jzvfr_0130d916-a4db-4418-afe6-32cc23cc95d1

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-jzvfr_0130d916-a4db-4418-afe6-32cc23cc95d1 became leader
(x6)

openshift-ingress

kubelet

e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-10f1a3-6f6f779d4b-95h9b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-10f1a3-d55fc9547-kj7nd

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0ac6bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0ac6bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9096a-6976b597b7-2kmj8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9096a-5dbbbd6d66-zfdxn

Killing

Stopping container payload-processing
(x11)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Error

Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service"
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x11)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Error

Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service"
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

Created

Container created
(x11)

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Error

Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service"
(x8)

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Error

Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service"
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a4f3f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a4f3f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-17df15-77f8475476

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-17df15-77f8475476-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-17df15: serviceaccount "payload-processing-e2e-ipp-b-17df15" not found
(x6)

openshift-ingress

kubelet

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

ProbeError

Startup probe error: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-17df15: serviceaccount "payload-processing-e2e-ipp-b-17df15" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-17df15

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

Unhealthy

Startup probe failed: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-17df15

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-17df15-77f8475476 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-e9096a-openshift-default-66f6d7f4dc-8lv74

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc-7blzv

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-17df15-77f8475476

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-17df15-77f8475476-bmgzk

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc-7blzv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc-7blzv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc-7blzv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc-7blzv

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-17df15-77f8475476-bmgzk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-17df15-77f8475476-bmgzk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-17df15-77f8475476-bmgzk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-17df15-77f8475476-bmgzk

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-17df15-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-17df15-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

deployment-controller

e2e-praxis-b-200c58-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-200c58-openshift-default-75b6749c97 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-200c58

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-200c58

openshift-ingress

replicaset-controller

e2e-praxis-b-200c58-openshift-default-75b6749c97

SuccessfulCreate

Created pod: e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-76135e-779fd9cbd7-4fqtg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-76135e-5d8b8684b6-g4jr8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-4n5fx

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-200c58: serviceaccount "payload-processing-e2e-praxis-b-200c58" not found

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-9rhcl

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-v7b8p

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-4n5fx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c-8k98q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-200c58

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-200c58: serviceaccount "payload-processing-e2e-praxis-b-200c58" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b-ppvqf
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-9rhcl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-v7b8p

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-200c58

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c-8k98q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b-ppvqf

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c-8k98q

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b-ppvqf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b-ppvqf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c-8k98q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c-8k98q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b-ppvqf

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-76135e-openshift-default-fd74fffc5-fd2vt

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a4f3f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a4f3f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-50b278

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-50b278

openshift-ingress

deployment-controller

e2e-praxis-a-50b278-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-50b278-openshift-default-6497867cfc from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-50b278-openshift-default-6497867cfc

SuccessfulCreate

Created pod: e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj

openshift-ingress

multus

e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-10f1a3-openshift-default-7ddf867857-rspfx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-50b278

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-50b278-fd5695c7b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-50b278-99494fc99-wv8sj

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-50b278-99494fc99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-50b278-99494fc99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-50b278: serviceaccount "payload-processing-e2e-praxis-a-50b278" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-50b278-fd5695c7b

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-50b278-fd5695c7b-mdddw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-50b278-99494fc99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-50b278-99494fc99-wv8sj

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-50b278-99494fc99-wv8sj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-50b278-99494fc99-wv8sj

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-50b278

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-50b278-99494fc99 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-50b278-fd5695c7b

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-50b278-fd5695c7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-50b278: serviceaccount "payload-processing-e2e-praxis-a-50b278" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-50b278-fd5695c7b-mdddw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-50b278-fd5695c7b-mdddw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-50b278-99494fc99-wv8sj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-50b278-fd5695c7b-mdddw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-50b278-fd5695c7b-mdddw

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-011d6f-cc789d486-srcwt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-011d6f-85479995f5-54sn4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0ac6bb-86c4fbf5cb-x5t46

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0ac6bb-67fc4d5447-5n5xd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-011d6f-openshift-default-555c887c5f-jkbfj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-17df15-6bc646d6bc-7blzv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-17df15-77f8475476-bmgzk

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 6 to 5

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xhh6v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-76597d6855 from 7 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-xhh6v

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-q5rz8

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-9q9g9

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-vhqlq

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-mpbz2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 6 to 5

openshift-ingress

kubelet

e2e-ipp-b-17df15-openshift-default-7cd5d6b88f-nswsn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-smn7m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-be7f9e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-be7f9e

openshift-ingress

replicaset-controller

e2e-praxis-b-afc614-openshift-default-55bd7c8977

SuccessfulCreate

Created pod: e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-afc614

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-afc614

openshift-ingress

deployment-controller

e2e-praxis-b-afc614-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-afc614-openshift-default-55bd7c8977 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-be7f9e-openshift-default-7cb56cd649

SuccessfulCreate

Created pod: e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r

openshift-ingress

deployment-controller

e2e-praxis-a-be7f9e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-be7f9e-openshift-default-7cb56cd649 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-200c58-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-200c58-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-50b278-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-50b278-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-afc614

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-afc614-78f958bbd8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-afc614

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79-8rgjs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-afc614: serviceaccount "payload-processing-e2e-praxis-b-afc614" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-afc614-78f958bbd8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-afc614-78f958bbd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-afc614: serviceaccount "payload-processing-e2e-praxis-b-afc614" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-afc614-78f958bbd8-dgrmm

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-afc614-78f958bbd8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-afc614-78f958bbd8-dgrmm

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79-8rgjs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79-8rgjs

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-be7f9e: serviceaccount "payload-processing-e2e-praxis-a-be7f9e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f-fv7sd
(x5)

openshift-ingress

kubelet

e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-be7f9e-576d7866d4

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-be7f9e-576d7866d4-9mpwv

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-be7f9e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-be7f9e-576d7866d4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79-8rgjs

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-be7f9e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79-8rgjs

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-be7f9e-576d7866d4

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-be7f9e-576d7866d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-be7f9e: serviceaccount "payload-processing-e2e-praxis-a-be7f9e" not found
(x5)

openshift-ingress

kubelet

e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-afc614-78f958bbd8-dgrmm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-afc614-78f958bbd8-dgrmm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-afc614-78f958bbd8-dgrmm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-be7f9e-576d7866d4-9mpwv

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-be7f9e-576d7866d4-9mpwv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-be7f9e-576d7866d4-9mpwv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-be7f9e-576d7866d4-9mpwv

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f-fv7sd

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f-fv7sd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f-fv7sd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f-fv7sd

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 5 to 3

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-r4k2t

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4k2t

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-89vg8

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-ljm4s

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-0ac6bb-openshift-default-745b898b59-7cbkl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-afc614-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-afc614-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e9b146

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e9b146

openshift-ingress

replicaset-controller

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf

SuccessfulCreate

Created pod: e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

openshift-ingress

deployment-controller

e2e-ipp-a-e9b146-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-200c58-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-200c58-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e9b146: serviceaccount "payload-processing-e2e-ipp-a-e9b146" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95-hh5lx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e9b146

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e9b146

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e9b146-6f5c4477d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e9b146-6f5c4477d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e9b146-6f5c4477d6-wd4nj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e9b146-6f5c4477d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e9b146-6f5c4477d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e9b146: serviceaccount "payload-processing-e2e-ipp-a-e9b146" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95-hh5lx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9b146-6f5c4477d6-wd4nj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95-hh5lx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9b146-6f5c4477d6-wd4nj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9b146-6f5c4477d6-wd4nj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-e9b146-6f5c4477d6-wd4nj

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95-hh5lx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95-hh5lx

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-74gqg

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-50b278-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-50b278-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 5 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-fkxzr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mrvcd

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-pssdt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-fkxzr

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-vsp44

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-chrr6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 5 to 3

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-tzhkc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mjl8p

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

Unhealthy

Startup probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

ProbeError

Startup probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r

ProbeError

Startup probe error: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r

Unhealthy

Startup probe failed: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f42594-87777b966-2nn2h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f42594-6fc446668c-6jr84

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-praxis-b-42bf6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-42bf6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-42bf6e

openshift-ingress

replicaset-controller

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5

SuccessfulCreate

Created pod: e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

openshift-ingress

multus

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-be7f9e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9b146-6f5c4477d6-wd4nj

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-be7f9e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9b146-f5b46dc95-hh5lx

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-42bf6e: serviceaccount "payload-processing-e2e-praxis-b-42bf6e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-42bf6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475-st662
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-42bf6e: serviceaccount "payload-processing-e2e-praxis-b-42bf6e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb-4q4fr

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-42bf6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-50b278-99494fc99-wv8sj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb-4q4fr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475-st662

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475-st662

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb-4q4fr

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-50b278-fd5695c7b-mdddw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb-4q4fr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475-st662

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475-st662

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb-4q4fr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-afc614-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-afc614-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-be7f9e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9b146-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9b146-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-be7f9e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e9b146-74dbdb8b44

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e9b146-74dbdb8b44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e9b146: serviceaccount "payload-processing-e2e-ipp-a-e9b146" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e9b146: serviceaccount "payload-processing-e2e-ipp-a-e9b146" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e9b146

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e9b146-74dbdb8b44 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e9b146

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9b146-74dbdb8b44-hzqmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e9b146-74dbdb8b44

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e9b146-74dbdb8b44-hzqmb

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987-gcz4x

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987-gcz4x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987-gcz4x

openshift-ingress

multus

payload-processing-e2e-ipp-a-e9b146-74dbdb8b44-hzqmb

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9b146-74dbdb8b44-hzqmb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9b146-74dbdb8b44-hzqmb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987-gcz4x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987-gcz4x

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-42bf6e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-42bf6e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-44379a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-44379a

openshift-ingress

deployment-controller

e2e-ipp-b-44379a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-44379a-openshift-default-57d99754b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-44379a-openshift-default-57d99754b9

SuccessfulCreate

Created pod: e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z

openshift-ingress

multus

e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-44379a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-44379a-6c575b68f4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-44379a-6c575b68f4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-44379a-6c575b68f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-44379a: serviceaccount "payload-processing-e2e-ipp-b-44379a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-44379a-6c575b68f4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-44379a-6c575b68f4-pkdt7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-44379a-79d8645f67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-44379a-79d8645f67-llqwl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-44379a-79d8645f67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-44379a-79d8645f67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-44379a: serviceaccount "payload-processing-e2e-ipp-b-44379a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-44379a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-44379a-79d8645f67 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-44379a-6c575b68f4-pkdt7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-44379a-79d8645f67-llqwl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-44379a-79d8645f67-llqwl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-44379a-79d8645f67-llqwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-44379a-6c575b68f4-pkdt7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-44379a-79d8645f67-llqwl

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-44379a-6c575b68f4-pkdt7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-44379a-6c575b68f4-pkdt7

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-50b278-openshift-default-6497867cfc-d9nkj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a4f3f0-594b877768-ctrsw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-7mxbc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9b146-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e9b146-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

Unhealthy

Readiness probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-f42594-openshift-default-c8d4dd6d7-ffjhp

ProbeError

Readiness probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-afc614-c4d5cff79-8rgjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-afc614-78f958bbd8-dgrmm

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-44379a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-44379a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a4f3f0-594b877768-ctrsw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a4f3f0-7c77897bf9-7mxbc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-b-afc614-openshift-default-55bd7c8977-vd6kw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-be7f9e-576d7866d4-9mpwv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-be7f9e-74c4c4589f-fv7sd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-be7f9e-openshift-default-7cb56cd649-8sn5r

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-42bf6e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-42bf6e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-44379a-6c575b68f4-pkdt7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-44379a-79d8645f67-llqwl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-42bf6e-69fdcc7bcb-4q4fr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42bf6e-658ff5475-st662

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f826dd-66fc94df7b-vd626

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f826dd-675f9fd755-t8pkx

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wgrr6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-wgrr6

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

Started

Container started

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv

Started

Container started

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-44379a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-44379a-644486f9dd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-44379a: serviceaccount "payload-processing-e2e-ipp-b-44379a" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-44379a-644486f9dd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-44379a-644486f9dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-44379a: serviceaccount "payload-processing-e2e-ipp-b-44379a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-44379a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5-q8xgr

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-44379a-644486f9dd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-44379a-644486f9dd-jgqh6

openshift-ingress

multus

payload-processing-e2e-ipp-b-44379a-644486f9dd-jgqh6

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-44379a-644486f9dd-jgqh6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5-q8xgr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5-q8xgr

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5-q8xgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-44379a-644486f9dd-jgqh6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5-q8xgr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-44379a-644486f9dd-jgqh6

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

ProbeError

Startup probe error: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

Unhealthy

Startup probe failed: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv

Unhealthy

Startup probe failed: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv

ProbeError

Startup probe error: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-42bf6e-openshift-default-6bc8854cb5-vnqpb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

Unhealthy

Startup probe failed: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

ProbeError

Startup probe error: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

Unhealthy

Startup probe failed: Get "http://10.134.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

ProbeError

Startup probe error: Get "http://10.134.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

ProbeError

Startup probe error: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

Unhealthy

Startup probe failed: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-f826dd-openshift-default-6fc76ff86f-fcvls

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-44379a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-44379a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-a4f3f0-openshift-default-668bf869d5-sjncf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e9b146-74dbdb8b44-hzqmb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e9b146-5bd74f8987-gcz4x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

Created

Container created

openshift-ingress

multus

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulCreate

Created pod: e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

ProbeError

Startup probe error: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

ProbeError

Startup probe error: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

Unhealthy

Startup probe failed: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-e9b146-openshift-default-5cfcd94dbf-fwbc5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

Unhealthy

Startup probe failed: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-44379a-86bb6c4f5-q8xgr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-44379a-644486f9dd-jgqh6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp

Started

Container started

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf

Created

Container created

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-44379a-openshift-default-57d99754b9-pgg7z

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

ProbeError

Readiness probe error: Get "http://10.134.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

ProbeError

Readiness probe error: Get "http://10.134.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

Unhealthy

Readiness probe failed: Get "http://10.134.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl

ProbeError

Startup probe error: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl

Unhealthy

Startup probe failed: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

Unhealthy

Readiness probe failed: Get "http://10.134.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-200c58-7c6bfb8c8b-ppvqf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-200c58-7d66656f4c-8k98q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulCreate

Created pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-z7c7b

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

Started

Container started

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

ProbeError

Startup probe error: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

Unhealthy

Startup probe failed: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

ProbeError

Startup probe error: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

Unhealthy

Startup probe failed: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-200c58-openshift-default-75b6749c97-9cbrv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulCreate

Created pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

Created

Container created

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

ProbeError

Startup probe error: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

Unhealthy

Startup probe failed: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

Unhealthy

Startup probe failed: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

ProbeError

Startup probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

ProbeError

Startup probe error: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

Unhealthy

Startup probe failed: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

ProbeError

Startup probe error: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

Unhealthy

Startup probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-ab244c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-ab244c

openshift-ingress

multus

e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ab244c-openshift-default-694869f597

SuccessfulCreate

Created pod: e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm

openshift-ingress

deployment-controller

e2e-shared-a-w3-ab244c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-ab244c-openshift-default-694869f597 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ab244c: serviceaccount "payload-processing-e2e-shared-a-w3-ab244c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-ab244c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-jbckm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ab244c: serviceaccount "payload-processing-e2e-shared-a-w3-ab244c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-ab244c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-wzn42

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-wzn42

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-wzn42

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-jbckm

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-jbckm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-wzn42

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-jbckm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-wzn42

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-jbckm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-675070

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-675070

openshift-ingress

replicaset-controller

e2e-shared-a-w2-675070-openshift-default-8b45bc97

SuccessfulCreate

Created pod: e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

openshift-ingress

deployment-controller

e2e-shared-a-w2-675070-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-675070-openshift-default-8b45bc97 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-vlm9c

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-675070: serviceaccount "payload-processing-e2e-shared-a-w2-675070" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-675070

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-4xv4f

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-1a2436

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-1a2436

openshift-ingress

deployment-controller

e2e-shared-a-w4-1a2436-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-1a2436-openshift-default-84b85bb969 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-675070

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-675070-5bf74cf574 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-675070-5bf74cf574

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-675070-5bf74cf574-r4wfr

openshift-ingress

replicaset-controller

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969

SuccessfulCreate

Created pod: e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-675070-5bf74cf574

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-675070-5bf74cf574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-675070: serviceaccount "payload-processing-e2e-shared-a-w2-675070" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-675070-5bf74cf574-r4wfr

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-4xv4f

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-4xv4f

Created

Container created

openshift-ingress

multus

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-675070-5bf74cf574-r4wfr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-4xv4f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-675070-5bf74cf574-r4wfr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-4xv4f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-675070-5bf74cf574-r4wfr

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w1-e95c51-openshift-default-7958f47665

SuccessfulCreate

Created pod: e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

openshift-ingress

deployment-controller

e2e-shared-a-w1-e95c51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-e95c51-openshift-default-7958f47665 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-e95c51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-e95c51

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-1a2436-567f469f4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-1a2436-567f469f4-qmp5p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-1a2436: serviceaccount "payload-processing-e2e-shared-a-w4-1a2436" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-1a2436-567f469f4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-1a2436-567f469f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-1a2436: serviceaccount "payload-processing-e2e-shared-a-w4-1a2436" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-1a2436

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-1a2436-567f469f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-jxlmq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-1a2436

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-1a2436-567f469f4-qmp5p

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-1a2436-567f469f4-qmp5p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-1a2436-567f469f4-qmp5p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-1a2436-567f469f4-qmp5p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-jxlmq

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-jxlmq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-jxlmq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-jxlmq

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulCreate

Created pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

Created

Container created

openshift-ingress

multus

e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-autores-1e0b31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-1e0b31-openshift-default-5b75cf549f from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-1e0b31-openshift-default-5b75cf549f

SuccessfulCreate

Created pod: e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst
(x7)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn

ProbeError

Startup probe error: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

Unhealthy

Startup probe failed: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn

Unhealthy

Startup probe failed: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-autores-1e0b31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-1e0b31
(x7)

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

ProbeError

Startup probe error: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-4a7508

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-4a7508

openshift-ingress

multus

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-4a7508-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9

SuccessfulCreate

Created pod: e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr

openshift-ingress

multus

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-e95c51: serviceaccount "payload-processing-e2e-shared-a-w1-e95c51" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-e95c51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-e95c51: serviceaccount "payload-processing-e2e-shared-a-w1-e95c51" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-e95c51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-ms29d

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-798lh

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-798lh

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-798lh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-798lh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-798lh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-ms29d

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-ms29d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-ms29d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-ms29d

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulCreate

Created pod: e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-skjjq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-4a7508

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-skjjq

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-wk8g4

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-4a7508

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-wk8g4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-skjjq

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4a7508: serviceaccount "payload-processing-e2e-shared-b-w3-4a7508" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-wk8g4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-wk8g4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-skjjq

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4a7508: serviceaccount "payload-processing-e2e-shared-b-w3-4a7508" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-skjjq

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-wk8g4

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm

Unhealthy

Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm

ProbeError

Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

ProbeError

Startup probe error: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

Unhealthy

Startup probe failed: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-autores-1e0b31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-1e0b31-786cbfd95b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-1e0b31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-1e0b31-67474fb659 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1e0b31-67474fb659-w9xtn

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1e0b31-67474fb659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-1e0b31-67474fb659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1e0b31: serviceaccount "payload-processing-e2e-autores-1e0b31" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1e0b31-786cbfd95b

FailedCreate

Error creating: pods "payload-processing-e2e-autores-1e0b31-786cbfd95b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1e0b31: serviceaccount "payload-processing-e2e-autores-1e0b31" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1e0b31-67474fb659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-1e0b31-67474fb659-w9xtn

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1e0b31-67474fb659-w9xtn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-1e0b31-786cbfd95b-cf8sp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-ab244c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-autores-1e0b31-786cbfd95b-cf8sp

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-ab244c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1e0b31-67474fb659-w9xtn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-autores-1e0b31-67474fb659-w9xtn

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1e0b31-786cbfd95b

SuccessfulCreate

Created pod: payload-processing-e2e-autores-1e0b31-786cbfd95b-cf8sp

openshift-ingress

kubelet

payload-processing-e2e-autores-1e0b31-786cbfd95b-cf8sp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-1e0b31-786cbfd95b-cf8sp

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-09ef1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-09ef1d

openshift-ingress

replicaset-controller

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67

SuccessfulCreate

Created pod: e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk

openshift-ingress

deployment-controller

e2e-shared-b-w2-09ef1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

Unhealthy

Readiness probe failed: Get "http://10.134.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

ProbeError

Readiness probe error: Get "http://10.134.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-ab244c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-ab244c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w4-24b124-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-24b124-openshift-default-77557bb57f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-24b124

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-24b124

openshift-ingress

replicaset-controller

e2e-shared-b-w4-24b124-openshift-default-77557bb57f

SuccessfulCreate

Created pod: e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

openshift-ingress

multus

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

Unhealthy

Startup probe failed: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

ProbeError

Startup probe error: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-675070-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-675070-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-09ef1d-54757db89b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-09ef1d: serviceaccount "payload-processing-e2e-shared-b-w2-09ef1d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-09ef1d: serviceaccount "payload-processing-e2e-shared-b-w2-09ef1d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-5snxw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-09ef1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-09ef1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-09ef1d-54757db89b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-09ef1d-54757db89b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-rvhxf

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-rvhxf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-5snxw

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-5snxw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-5snxw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-5snxw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-rvhxf

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-rvhxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-rvhxf

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-24b124: serviceaccount "payload-processing-e2e-shared-b-w4-24b124" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-24b124

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-24b124-6454ddcf88 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-24b124-6454ddcf88

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-24b124: serviceaccount "payload-processing-e2e-shared-b-w4-24b124" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-24b124

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-gcv88

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-24b124-6454ddcf88

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-rgb5c

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-gcv88

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-rgb5c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-rgb5c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-rgb5c

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-rgb5c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-gcv88

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-gcv88

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-gcv88

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-1a2436-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-1a2436-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-675070-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-675070-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

Unhealthy

Readiness probe failed: Get "http://10.134.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

ProbeError

Readiness probe error: Get "http://10.134.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w1-d82e82-openshift-default-58686789bf

SuccessfulCreate

Created pod: e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-d82e82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-d82e82
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-b-w1-d82e82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-d82e82-openshift-default-58686789bf from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-1a2436-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-1a2436-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr

ProbeError

Startup probe error: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr

Unhealthy

Startup probe failed: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4a7508-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4a7508-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-d82e82: serviceaccount "payload-processing-e2e-shared-b-w1-d82e82" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-d82e82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-pmqhf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-d82e82: serviceaccount "payload-processing-e2e-shared-b-w1-d82e82" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-d82e82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-dtq2s

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-pmqhf

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-dtq2s

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-dtq2s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-dtq2s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-dtq2s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-pmqhf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-pmqhf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-pmqhf

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e95c51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e95c51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk

Unhealthy

Startup probe failed: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk

ProbeError

Startup probe error: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-1e0b31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-1e0b31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4a7508-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4a7508-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e95c51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e95c51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-09ef1d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-09ef1d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

ProbeError

Readiness probe error: Get "http://10.134.0.194:15021/healthz/ready": read tcp 10.134.0.2:36602->10.134.0.194:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

Unhealthy

Readiness probe failed: Get "http://10.134.0.194:15021/healthz/ready": read tcp 10.134.0.2:36602->10.134.0.194:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

ProbeError

Startup probe error: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

Unhealthy

Startup probe failed: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-1e0b31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-1e0b31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-a-w3-ab244c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-ab244c-openshift-default-694869f597 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-ab244c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ab244c-openshift-default-694869f597

SuccessfulCreate

Created pod: e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-24b124-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-24b124-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d82e82-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d82e82-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-1a2436-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w4-1a2436-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-1a2436-openshift-default-84b85bb969 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969

SuccessfulCreate

Created pod: e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

Created

Container created

openshift-ingress

multus

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-autores-1e0b31-786cbfd95b-cf8sp

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1e0b31-67474fb659-w9xtn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w8sfs

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-24b124-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-24b124-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d82e82-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d82e82-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9

SuccessfulCreate

Created pod: e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4a7508-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w3-4a7508-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9 from 1 to 2

openshift-ingress

kubelet

e2e-autores-1e0b31-openshift-default-5b75cf549f-q4wst

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-explicit-160bf8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-160bf8

openshift-ingress

deployment-controller

e2e-explicit-160bf8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-160bf8-openshift-default-5c6f5df4b5 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-explicit-160bf8-openshift-default-5c6f5df4b5

SuccessfulCreate

Created pod: e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

openshift-ingress

multus

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-160bf8-74f657fbf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-160bf8-74f657fbf9-kfw2h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-160bf8-74f657fbf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-160bf8-74f657fbf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-160bf8: serviceaccount "payload-processing-e2e-explicit-160bf8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-160bf8-857d864c68

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-160bf8-857d864c68-p4svr

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-160bf8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-160bf8-857d864c68 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-160bf8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-160bf8-74f657fbf9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-160bf8-857d864c68

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-160bf8-857d864c68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-160bf8: serviceaccount "payload-processing-e2e-explicit-160bf8" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-160bf8-74f657fbf9-kfw2h

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-160bf8-74f657fbf9-kfw2h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-160bf8-857d864c68-p4svr

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-160bf8-857d864c68-p4svr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-160bf8-857d864c68-p4svr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-160bf8-857d864c68-p4svr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-160bf8-74f657fbf9-kfw2h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-160bf8-74f657fbf9-kfw2h

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d82e82-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w1-d82e82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-d82e82-openshift-default-58686789bf from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w1-d82e82-openshift-default-58686789bf

SuccessfulCreate

Created pod: e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

openshift-ingress

multus

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

Unhealthy

Startup probe failed: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

ProbeError

Startup probe error: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-160bf8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-160bf8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

ProbeError

Startup probe error: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

Unhealthy

Startup probe failed: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rkjpn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-tk9qw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-zlrrg

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-z9dpj

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-bv2pl
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-160bf8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-160bf8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-explicit-160bf8-857d864c68-p4svr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-160bf8-74f657fbf9-kfw2h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-kqxfp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-jt8qp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-npw74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-p8j8n

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-rq5th

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-q8b8d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-hnrww

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7616-ba9af8

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7616-ba9af8

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7616-ba9af8

Started

Container started

opendatahub

kubelet

test-curl-7616-ba9af8

Created

Container created

openshift-ingress

kubelet

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-160bf8-openshift-default-5c6f5df4b5-p2z77

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-7616-ba9af8

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.422s (2.422s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7616-b9f8ed

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7616-b9f8ed

Started

Container started

opendatahub

kubelet

test-curl-7616-b9f8ed

Created

Container created

opendatahub

kubelet

test-curl-7616-ba9af8

Killing

Stopping container test-curl-7616-ba9af8

opendatahub

multus

test-curl-7616-b9f8ed

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 5 to 4

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-fcxl2

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7616-b9f8ed

Killing

Stopping container test-curl-7616-b9f8ed

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-236fc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-236fc4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-s7c2z

openshift-ingress

replicaset-controller

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9

SuccessfulCreate

Created pod: e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

openshift-ingress

deployment-controller

e2e-shared-a-w0-236fc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-236fc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-236fc4-88f5755fb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-236fc4: serviceaccount "payload-processing-e2e-shared-a-w0-236fc4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-236fc4-88f5755fb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-fskbl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-236fc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-236fc4-88f5755fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-236fc4: serviceaccount "payload-processing-e2e-shared-a-w0-236fc4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-xxv8l

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-fskbl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-fskbl

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-fskbl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-xxv8l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-xxv8l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-xxv8l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-xxv8l

AddedInterface

Add eth0 [10.134.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-fskbl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-kwkl4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-mqdpp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-xlrwn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-8b9cs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-gzlfv
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tlvmf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-slc6f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-l72wn
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-pjcpt

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7628-b718f6

Created

Container created

opendatahub

kubelet

test-curl-7628-b718f6

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7628-b718f6

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7628-b718f6

Started

Container started

opendatahub

multus

test-curl-7628-b6f680

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7628-b6f680

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7628-b6f680

Started

Container started

opendatahub

kubelet

test-curl-7628-b6f680

Created

Container created

opendatahub

kubelet

test-curl-7628-b718f6

Killing

Stopping container test-curl-7628-b718f6

openshift-ingress

deployment-controller

e2e-extmod-a-2107d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-2107d4-openshift-default-659d97db85 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-2107d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-2107d4

openshift-ingress

replicaset-controller

e2e-extmod-a-2107d4-openshift-default-659d97db85

SuccessfulCreate

Created pod: e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk

openshift-ingress

multus

e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-236fc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-236fc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7622-99ea9a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

Unhealthy

Startup probe failed: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused

opendatahub

kubelet

test-curl-7622-99ea9a

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

ProbeError

Startup probe error: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7622-99ea9a

Created

Container created

opendatahub

multus

test-curl-7622-99ea9a

AddedInterface

Add eth0 [10.134.0.219/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7622-99ea9a

Killing

Stopping container test-curl-7622-99ea9a

openshift-ingress

deployment-controller

e2e-shared-b-w0-c095fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-c095fa-openshift-default-756895fbf7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7

SuccessfulCreate

Created pod: e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-c095fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-c095fa

openshift-ingress

multus

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2107d4: serviceaccount "payload-processing-e2e-extmod-a-2107d4" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2107d4-7bf5b8d588

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2107d4: serviceaccount "payload-processing-e2e-extmod-a-2107d4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-2107d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-2107d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-2107d4-7bf5b8d588 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-hz7nk

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-nt76m

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-nt76m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-nt76m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-nt76m

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2107d4-7bf5b8d588

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-hz7nk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-nt76m

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-hz7nk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-hz7nk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-hz7nk

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-c095fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-c095fa: serviceaccount "payload-processing-e2e-shared-b-w0-c095fa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-c095fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-c095fa: serviceaccount "payload-processing-e2e-shared-b-w0-c095fa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-rgj6w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-lvpxv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-rgj6w

AddedInterface

Add eth0 [10.134.0.224/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-lvpxv

AddedInterface

Add eth0 [10.134.0.225/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-rgj6w

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-lvpxv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-rgj6w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-rgj6w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-lvpxv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-lvpxv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-236fc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-236fc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-noten-4c75d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-4c75d7-openshift-default-59bbf9cdb5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-4c75d7-openshift-default-59bbf9cdb5

SuccessfulCreate

Created pod: e2e-noten-4c75d7-openshift-default-59bbf9cdb5-qrhzh

openshift-ingress

gateway_labeler_controller

e2e-noten-4c75d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-4c75d7

openshift-ingress

kubelet

e2e-noten-4c75d7-openshift-default-59bbf9cdb5-qrhzh

Created

Container created

openshift-ingress

multus

e2e-noten-4c75d7-openshift-default-59bbf9cdb5-qrhzh

AddedInterface

Add eth0 [10.134.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-4c75d7-openshift-default-59bbf9cdb5-qrhzh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-4c75d7-openshift-default-59bbf9cdb5-qrhzh

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-wm7rb

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7628-b6f680

Killing

Stopping container test-curl-7628-b6f680

openshift-ingress

replicaset-controller

e2e-extmod-a-1c4bcd-openshift-default-847756f8fc

SuccessfulCreate

Created pod: e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-1c4bcd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-1c4bcd

openshift-ingress

deployment-controller

e2e-extmod-a-1c4bcd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-1c4bcd-openshift-default-847756f8fc from 0 to 1

openshift-ingress

multus

e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq

AddedInterface

Add eth0 [10.134.0.228/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-4c75d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-4c75d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-1c4bcd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-1c4bcd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-1c4bcd-55d686745d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-1c4bcd-55d686745d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-1c4bcd-55d686745d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-1c4bcd: serviceaccount "payload-processing-e2e-extmod-a-1c4bcd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-q4ttx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-1c4bcd: serviceaccount "payload-processing-e2e-extmod-a-1c4bcd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-1c4bcd-55d686745d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-1c4bcd-55d686745d-4hhzp

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-q4ttx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1c4bcd-55d686745d-4hhzp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1c4bcd-55d686745d-4hhzp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-q4ttx

AddedInterface

Add eth0 [10.134.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1c4bcd-55d686745d-4hhzp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-1c4bcd-55d686745d-4hhzp

AddedInterface

Add eth0 [10.134.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-q4ttx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-q4ttx

Created

Container created
(x3)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-76597d6855-w98z7

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-46hwv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-w98z7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-d1a330-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d1a330-openshift-default-5f66d94d4f from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f

SuccessfulCreate

Created pod: e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d1a330

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d1a330

openshift-ingress

multus

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

AddedInterface

Add eth0 [10.134.0.231/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d1a330

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d1a330-86c85f76d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d1a330-86c85f76d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d1a330: serviceaccount "payload-processing-e2e-extmod-a-d1a330" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d1a330: serviceaccount "payload-processing-e2e-extmod-a-d1a330" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d1a330-86c85f76d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d1a330-86c85f76d-mhswn

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d1a330

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d1a330-86c85f76d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-88bvg

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d1a330-86c85f76d-mhswn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-88bvg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-88bvg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-88bvg

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-d1a330-86c85f76d-mhswn

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-88bvg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d1a330-86c85f76d-mhswn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d1a330-86c85f76d-mhswn

Created

Container created

openshift-ingress

kubelet

e2e-noten-4c75d7-openshift-default-59bbf9cdb5-qrhzh

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk

ProbeError

Startup probe error: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk

Unhealthy

Startup probe failed: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2107d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2107d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-38e0db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-38e0db-openshift-default-559cb7d8df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-38e0db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-38e0db

openshift-ingress

replicaset-controller

e2e-extmod-b-38e0db-openshift-default-559cb7d8df

SuccessfulCreate

Created pod: e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

openshift-ingress

multus

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

AddedInterface

Add eth0 [10.134.0.232/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-38e0db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-38e0db-674844768b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-38e0db: serviceaccount "payload-processing-e2e-extmod-b-38e0db" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-38e0db-674844768b-xkbkd

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-38e0db-674844768b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-38e0db-674844768b-xkbkd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-sjkjz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-38e0db-674844768b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-38e0db-674844768b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-38e0db: serviceaccount "payload-processing-e2e-extmod-b-38e0db" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-sjkjz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-38e0db-674844768b-xkbkd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-sjkjz

AddedInterface

Add eth0 [10.134.0.233/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-38e0db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-38e0db-674844768b-xkbkd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-38e0db-674844768b-xkbkd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-sjkjz

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2107d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2107d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-sjkjz

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp

ProbeError

Startup probe error: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp

Unhealthy

Startup probe failed: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c095fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c095fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9

SuccessfulCreate

Created pod: e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-713dc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-713dc8

openshift-ingress

deployment-controller

e2e-extmod-a-713dc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn

AddedInterface

Add eth0 [10.134.0.234/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-861bb3-openshift-default-547b4c86df

SuccessfulCreate

Created pod: e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

openshift-ingress

deployment-controller

e2e-extmod-a-861bb3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-861bb3-openshift-default-547b4c86df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-861bb3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-861bb3

openshift-ingress

multus

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-713dc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-713dc8-7d557467f6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-713dc8-798785c495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-713dc8-798785c495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-713dc8: serviceaccount "payload-processing-e2e-extmod-a-713dc8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-713dc8-798785c495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-713dc8-798785c495-lqlhs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-713dc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-713dc8-798785c495 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-713dc8-7d557467f6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-713dc8-7d557467f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-713dc8: serviceaccount "payload-processing-e2e-extmod-a-713dc8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-713dc8-7d557467f6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-713dc8-7d557467f6-5nq4t
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-713dc8-7d557467f6-5nq4t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-713dc8-7d557467f6-5nq4t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-713dc8-798785c495-lqlhs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-713dc8-798785c495-lqlhs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-713dc8-7d557467f6-5nq4t

AddedInterface

Add eth0 [10.132.0.238/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-713dc8-798785c495-lqlhs

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-713dc8-7d557467f6-5nq4t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-861bb3-589555cc9b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-861bb3-589555cc9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-861bb3: serviceaccount "payload-processing-e2e-extmod-a-861bb3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-861bb3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-861bb3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-861bb3-589555cc9b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-713dc8-798785c495-lqlhs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1c4bcd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-c4k7q

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-c4k7q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-c4k7q

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1c4bcd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-extmod-a-861bb3-589555cc9b-k659d

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-c4k7q
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-861bb3: serviceaccount "payload-processing-e2e-extmod-a-861bb3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-c4k7q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-861bb3-589555cc9b-k659d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-861bb3-589555cc9b-k659d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-861bb3-589555cc9b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-861bb3-589555cc9b-k659d

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-861bb3-589555cc9b-k659d

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c095fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c095fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq

Unhealthy

Startup probe failed: Get "http://10.134.0.228:15021/healthz/ready": dial tcp 10.134.0.228:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq

ProbeError

Startup probe error: Get "http://10.134.0.228:15021/healthz/ready": dial tcp 10.134.0.228:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-8b8e54

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-8b8e54

openshift-ingress

replicaset-controller

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85

SuccessfulCreate

Created pod: e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm

openshift-ingress

deployment-controller

e2e-extmod-b-8b8e54-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-8b8e54: serviceaccount "payload-processing-e2e-extmod-b-8b8e54" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-nl5nn

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-j8v2w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-8b8e54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-8b8e54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-8b8e54: serviceaccount "payload-processing-e2e-extmod-b-8b8e54" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-j8v2w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-j8v2w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-j8v2w

AddedInterface

Add eth0 [10.134.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-j8v2w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-nl5nn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-nl5nn

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-nl5nn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-nl5nn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

ProbeError

Readiness probe error: Get "http://10.134.0.231:15021/healthz/ready": read tcp 10.134.0.2:60368->10.134.0.231:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

Unhealthy

Readiness probe failed: Get "http://10.134.0.231:15021/healthz/ready": read tcp 10.134.0.2:60368->10.134.0.231:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

Unhealthy

Startup probe failed: Get "http://10.134.0.231:15021/healthz/ready": dial tcp 10.134.0.231:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

ProbeError

Startup probe error: Get "http://10.134.0.231:15021/healthz/ready": dial tcp 10.134.0.231:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d1a330-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d1a330-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1c4bcd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1c4bcd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-6babca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-6babca-openshift-default-cb56dc55c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-6babca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-6babca

openshift-ingress

replicaset-controller

e2e-extmod-b-6babca-openshift-default-cb56dc55c

SuccessfulCreate

Created pod: e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm

openshift-ingress

multus

e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm

AddedInterface

Add eth0 [10.134.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-mkqg7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-tzxml
(x7)

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 4 to 2
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d1a330-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d1a330-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-6babca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-6babca-6dc6645cb4 from 0 to 1

openshift-ingress

kubelet

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

ProbeError

Readiness probe error: Get "http://10.134.0.232:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

Unhealthy

Readiness probe failed: Get "http://10.134.0.232:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-6babca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6babca-6dc6645cb4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-6babca-6dc6645cb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6babca: serviceaccount "payload-processing-e2e-extmod-b-6babca" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-tlrg5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6babca: serviceaccount "payload-processing-e2e-extmod-b-6babca" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-tlrg5

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-tlrg5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-tlrg5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-tlrg5

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6babca-6dc6645cb4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-6babca-6dc6645cb4-jw8l5

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6babca-6dc6645cb4-jw8l5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-6babca-6dc6645cb4-jw8l5

AddedInterface

Add eth0 [10.134.0.238/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6babca-6dc6645cb4-jw8l5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6babca-6dc6645cb4-jw8l5

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

Unhealthy

Startup probe failed: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

ProbeError

Startup probe error: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

Unhealthy

Startup probe failed: Get "http://10.134.0.235:15021/healthz/ready": dial tcp 10.134.0.235:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

ProbeError

Startup probe error: Get "http://10.134.0.235:15021/healthz/ready": dial tcp 10.134.0.235:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn

Unhealthy

Startup probe failed: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn

ProbeError

Startup probe error: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-38e0db-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-38e0db-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-713dc8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-713dc8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-861bb3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-861bb3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x6)

openshift-ingress

deployment-controller

e2e-worker-w4-fe1374-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-fe1374-openshift-default-5dc59487b5 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-q2v5b

Killing

Stopping container istio-proxy
(x9)

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 3 to 2

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-n4tnn
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w4-fe1374-openshift-default-5dc59487b5

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-bckhr

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-fe1374-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5

SuccessfulCreate

Created pod: e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-39c99d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-39c99d

openshift-ingress

multus

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-39c99d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79-ltfgp

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-39c99d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-39c99d-57d5954c5b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-39c99d-57d5954c5b-cv4v2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-39c99d: serviceaccount "payload-processing-e2e-extmod-b-39c99d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79-ltfgp

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79-ltfgp

AddedInterface

Add eth0 [10.132.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79-ltfgp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-39c99d-57d5954c5b-cv4v2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-39c99d-57d5954c5b-cv4v2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-39c99d-57d5954c5b-cv4v2

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-39c99d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-39c99d-57d5954c5b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79-ltfgp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-39c99d-57d5954c5b-cv4v2

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-39c99d-57d5954c5b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-39c99d-57d5954c5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-39c99d: serviceaccount "payload-processing-e2e-extmod-b-39c99d" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-713dc8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-713dc8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-861bb3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-861bb3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-6018b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-6018b4

openshift-ingress

replicaset-controller

e2e-extmod-b-6018b4-openshift-default-7fd78b55cc

SuccessfulCreate

Created pod: e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q

openshift-ingress

deployment-controller

e2e-extmod-b-6018b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-6018b4-openshift-default-7fd78b55cc from 0 to 1

openshift-ingress

multus

e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6018b4-f55df5fb8

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-6018b4-f55df5fb8-4gsb2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6018b4: serviceaccount "payload-processing-e2e-extmod-b-6018b4" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6018b4-f55df5fb8

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-6018b4-f55df5fb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6018b4: serviceaccount "payload-processing-e2e-extmod-b-6018b4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-6018b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-6018b4-f55df5fb8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-r5frb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-6018b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-r5frb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6018b4-f55df5fb8-4gsb2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-r5frb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-6018b4-f55df5fb8-4gsb2

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-r5frb

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-r5frb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6018b4-f55df5fb8-4gsb2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6018b4-f55df5fb8-4gsb2

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8b8e54-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8b8e54-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-39c99d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-39c99d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6babca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6babca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm

Unhealthy

Startup probe failed: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm

ProbeError

Startup probe error: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8b8e54-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8b8e54-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-jp4hq

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x7)

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 3 to 2
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6babca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6babca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

Unhealthy

Readiness probe failed: Get "http://10.133.0.119:15021/healthz/ready": read tcp 10.133.0.2:35122->10.133.0.119:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

ProbeError

Readiness probe error: Get "http://10.133.0.119:15021/healthz/ready": read tcp 10.133.0.2:35122->10.133.0.119:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-a-w3-ab244c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-ab244c-openshift-default-694869f597 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-ab244c-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ab244c-openshift-default-694869f597

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-h76qm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6018b4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6018b4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-39c99d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-39c99d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w4-1a2436-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-1a2436-openshift-default-84b85bb969 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-1a2436-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-6swpk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-4a7508-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4a7508-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-66rmj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6018b4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6018b4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8b8e54-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-8b8e54-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85 from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85

SuccessfulCreate

Created pod: e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

Created

Container created

openshift-ingress

multus

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

AddedInterface

Add eth0 [10.134.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

ProbeError

Startup probe error: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

Unhealthy

Startup probe failed: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-78bf69cc96

SuccessfulCreate

Created pod: payload-processing-external-model-78bf69cc96-bscgp

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-78bf69cc96 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-78bf69cc96

FailedCreate

Error creating: pods "payload-processing-external-model-78bf69cc96-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-78bf69cc96-bscgp

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-78bf69cc96-bscgp

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-78bf69cc96-bscgp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-78bf69cc96-bscgp

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-78bf69cc96-bscgp

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7d48d4766c

SuccessfulCreate

Created pod: payload-processing-external-model-7d48d4766c-jkhqb
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-7d48d4766c

FailedCreate

Error creating: pods "payload-processing-external-model-7d48d4766c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7d48d4766c from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-7d48d4766c-jkhqb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7d48d4766c-jkhqb

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7d48d4766c-jkhqb

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7d48d4766c-jkhqb

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-5hmsm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-7jqjz

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-7jqjz

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7jqjz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7jqjz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7jqjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5hmsm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5hmsm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5hmsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-5hmsm

AddedInterface

Add eth0 [10.132.0.247/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7jqjz

ProbeError

Startup probe error: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5hmsm

Unhealthy

Startup probe failed: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7jqjz

Unhealthy

Startup probe failed: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5hmsm

ProbeError

Startup probe error: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-7d48d4766c-jkhqb

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7d48d4766c

SuccessfulCreate

Created pod: payload-processing-external-model-7d48d4766c-p8l8h
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-7d48d4766c

FailedCreate

Error creating: pods "payload-processing-external-model-7d48d4766c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7d48d4766c from 0 to 1

models-as-a-service

multus

payload-processing-external-model-7d48d4766c-p8l8h

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7d48d4766c-p8l8h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7d48d4766c-p8l8h

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7d48d4766c-p8l8h

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-46d6l

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-46d6l

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-46d6l

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-46d6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-46d6l

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7d48d4766c-p8l8h

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-46d6l

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-46d6l

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-46d6l

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-46d6l

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-z2dn9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-z2dn9

AddedInterface

Add eth0 [10.134.0.255/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

ProbeError

Startup probe error: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

Unhealthy

Startup probe failed: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

Unhealthy

Startup probe failed: Get "http://10.134.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

ProbeError

Startup probe error: Get "http://10.134.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-5cfxk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-wwft7

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-5cfxk

AddedInterface

Add eth0 [10.132.0.248/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-wwft7

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5cfxk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5cfxk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wwft7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wwft7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wwft7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5cfxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wwft7

ProbeError

Startup probe error: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5cfxk

ProbeError

Startup probe error: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5cfxk

Unhealthy

Startup probe failed: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wwft7

Unhealthy

Startup probe failed: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-t7sdc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-p6n4s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-76597d6855-2pbp9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-p6n4s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-2pbp9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-2pbp9

AddedInterface

Add eth0 [10.134.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-2pbp9

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-p6n4s

AddedInterface

Add eth0 [10.132.0.249/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-p6n4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-p6n4s

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-t7sdc

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-t7sdc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-t7sdc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-2pbp9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-t7sdc

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-a-0cc6b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-0cc6b1

openshift-ingress

deployment-controller

e2e-inf-a-0cc6b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-0cc6b1-openshift-default-7844696f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-0cc6b1-openshift-default-7844696f7

SuccessfulCreate

Created pod: e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr

openshift-ingress

multus

e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr

AddedInterface

Add eth0 [10.134.1.1/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-p6n4s

ProbeError

Startup probe error: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-2pbp9

Unhealthy

Startup probe failed: Get "http://10.134.1.0:15021/healthz/ready": dial tcp 10.134.1.0:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-2pbp9

ProbeError

Startup probe error: Get "http://10.134.1.0:15021/healthz/ready": dial tcp 10.134.1.0:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-t7sdc

Unhealthy

Startup probe failed: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-t7sdc

ProbeError

Startup probe error: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-p6n4s

Unhealthy

Startup probe failed: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-0cc6b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-0cc6b1-58d46575d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-0cc6b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0cc6b1: serviceaccount "payload-processing-e2e-inf-a-0cc6b1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-6wq4j
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0cc6b1-58d46575d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-0cc6b1-58d46575d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0cc6b1: serviceaccount "payload-processing-e2e-inf-a-0cc6b1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-6wq4j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-0cc6b1-58d46575d-ww7q2

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-6wq4j

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0cc6b1-58d46575d-ww7q2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0cc6b1-58d46575d-ww7q2

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0cc6b1-58d46575d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-0cc6b1-58d46575d-ww7q2

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0cc6b1-58d46575d-ww7q2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-6wq4j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-6wq4j

Started

Container started
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-595fbb7bb9

FailedCreate

Error creating: pods "payload-processing-external-model-595fbb7bb9-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-595fbb7bb9

SuccessfulCreate

Created pod: payload-processing-external-model-595fbb7bb9-vgwvw

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-595fbb7bb9 from 0 to 1
(x2)

models-as-a-service

kubelet

payload-processing-external-model-595fbb7bb9-vgwvw

FailedMount

MountVolume.SetUp failed for volume "kube-api-access-sthdr" : failed to fetch token: serviceaccounts "payload-processing-external-model" not found
(x2)

models-as-a-service

kubelet

payload-processing-external-model-595fbb7bb9-vgwvw

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-940f10a431a6" not found
(x2)

models-as-a-service

kubelet

payload-processing-external-model-595fbb7bb9-vgwvw

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-external-model-plugins" not found

models-as-a-service

kubelet

payload-processing-external-model-595fbb7bb9-vgwvw

FailedMount

MountVolume.SetUp failed for volume "kube-api-access-sthdr" : [failed to fetch token: serviceaccounts "payload-processing-external-model" is forbidden: User "system:node:ip-10-0-128-246.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "models-as-a-service": no relationship found between node 'ip-10-0-128-246.ec2.internal' and this object, object "models-as-a-service"/"kube-root-ca.crt" not registered, object "models-as-a-service"/"openshift-service-ca.crt" not registered]

models-as-a-service

kubelet

payload-processing-external-model-595fbb7bb9-vgwvw

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : object "models-as-a-service"/"agc-cred-940f10a431a6" not registered

models-as-a-service

kubelet

payload-processing-external-model-595fbb7bb9-vgwvw

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : object "models-as-a-service"/"payload-processing-external-model-plugins" not registered

openshift-ingress

deployment-controller

e2e-inf-a-1aa59a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1aa59a-openshift-default-579999c475 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1aa59a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1aa59a

openshift-ingress

replicaset-controller

e2e-inf-a-1aa59a-openshift-default-579999c475

SuccessfulCreate

Created pod: e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2

openshift-ingress

multus

e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1aa59a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1aa59a-5f69877548 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1aa59a-5f69877548

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1aa59a-5f69877548-fppdt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1aa59a-5f69877548

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1aa59a-5f69877548-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1aa59a: serviceaccount "payload-processing-e2e-inf-a-1aa59a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1aa59a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-s9pmv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1aa59a: serviceaccount "payload-processing-e2e-inf-a-1aa59a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-s9pmv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-s9pmv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-1aa59a-5f69877548-fppdt

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1aa59a-5f69877548-fppdt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1aa59a-5f69877548-fppdt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1aa59a-5f69877548-fppdt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-s9pmv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-s9pmv

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-6656cd76c4

FailedCreate

Error creating: pods "payload-processing-external-model-6656cd76c4-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-6656cd76c4

SuccessfulCreate

Created pod: payload-processing-external-model-6656cd76c4-lf7dr

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6656cd76c4 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-6656cd76c4-lf7dr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6656cd76c4-lf7dr

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6656cd76c4-lf7dr

Started

Container started

models-as-a-service

multus

payload-processing-external-model-6656cd76c4-lf7dr

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c52ec7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c52ec7

openshift-ingress

deployment-controller

e2e-inf-b-c52ec7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c52ec7-openshift-default-78bf6c4c47 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-c52ec7-openshift-default-78bf6c4c47

SuccessfulCreate

Created pod: e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w

openshift-ingress

multus

e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w

AddedInterface

Add eth0 [10.134.1.3/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0cc6b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0cc6b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr

ProbeError

Startup probe error: Get "http://10.134.1.1:15021/healthz/ready": dial tcp 10.134.1.1:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr

Unhealthy

Startup probe failed: Get "http://10.134.1.1:15021/healthz/ready": dial tcp 10.134.1.1:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c52ec7-f6884465b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c52ec7-f6884465b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c52ec7: serviceaccount "payload-processing-e2e-inf-b-c52ec7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-zvsc8

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c52ec7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c52ec7-f6884465b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c52ec7: serviceaccount "payload-processing-e2e-inf-b-c52ec7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c52ec7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c52ec7-f6884465b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c52ec7-f6884465b-465q7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-2pbp9

ProbeError

Readiness probe error: Get "http://10.134.1.0:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5cfxk

ProbeError

Readiness probe error: Get "http://10.132.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5hmsm

Unhealthy

Readiness probe failed: Get "http://10.132.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5hmsm

ProbeError

Readiness probe error: Get "http://10.132.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-2pbp9

Unhealthy

Readiness probe failed: Get "http://10.134.1.0:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wwft7

Unhealthy

Readiness probe failed: Get "http://10.133.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wwft7

ProbeError

Readiness probe error: Get "http://10.133.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7jqjz

ProbeError

Readiness probe error: Get "http://10.133.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-t7sdc

Unhealthy

Readiness probe failed: Get "http://10.133.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-t7sdc

ProbeError

Readiness probe error: Get "http://10.133.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5cfxk

Unhealthy

Readiness probe failed: Get "http://10.132.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-p6n4s

Unhealthy

Readiness probe failed: Get "http://10.132.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-p6n4s

ProbeError

Readiness probe error: Get "http://10.132.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7jqjz

Unhealthy

Readiness probe failed: Get "http://10.133.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-zvsc8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-zvsc8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-zvsc8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-zvsc8

AddedInterface

Add eth0 [10.133.0.196/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-c52ec7-f6884465b-465q7

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c52ec7-f6884465b-465q7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c52ec7-f6884465b-465q7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c52ec7-f6884465b-465q7

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6656cd76c4-lf7dr

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0cc6b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-inf-a-8862aa-openshift-default-65c476f4d7

SuccessfulCreate

Created pod: e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0cc6b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-a-8862aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-8862aa

openshift-ingress

deployment-controller

e2e-inf-a-8862aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-8862aa-openshift-default-65c476f4d7 from 0 to 1

openshift-ingress

multus

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

AddedInterface

Add eth0 [10.134.1.4/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8862aa-7d764b8787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8862aa: serviceaccount "payload-processing-e2e-inf-a-8862aa" not found
(x2)

openshift-ingress

kubelet

e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-8862aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-8862aa-55748dd5d8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8862aa-55748dd5d8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-8862aa-55748dd5d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8862aa: serviceaccount "payload-processing-e2e-inf-a-8862aa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-8862aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-8862aa-7d764b8787 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8862aa-7d764b8787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-8ln4k

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-8ln4k

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8862aa-55748dd5d8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-8862aa-55748dd5d8-slvct

openshift-ingress

multus

payload-processing-e2e-inf-a-8862aa-55748dd5d8-slvct

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8862aa-55748dd5d8-slvct

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-8ln4k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-8ln4k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-8ln4k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8862aa-55748dd5d8-slvct

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8862aa-55748dd5d8-slvct

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2

ProbeError

Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2

Unhealthy

Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1aa59a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1aa59a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1aa59a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1aa59a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-b-551d0b-openshift-default-57c5b6c45f

SuccessfulCreate

Created pod: e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

openshift-ingress

gateway_labeler_controller

e2e-inf-b-551d0b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-551d0b

openshift-ingress

deployment-controller

e2e-inf-b-551d0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-551d0b-openshift-default-57c5b6c45f from 0 to 1

openshift-ingress

multus

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-551d0b-6686dd876d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-551d0b-6686dd876d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-551d0b: serviceaccount "payload-processing-e2e-inf-b-551d0b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-551d0b: serviceaccount "payload-processing-e2e-inf-b-551d0b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-xtrvj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-551d0b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-551d0b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-551d0b-6686dd876d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-551d0b-6686dd876d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-551d0b-6686dd876d-qvsgq

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-xtrvj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-551d0b-6686dd876d-qvsgq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-xtrvj

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-551d0b-6686dd876d-qvsgq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-xtrvj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-551d0b-6686dd876d-qvsgq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-xtrvj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-551d0b-6686dd876d-qvsgq

AddedInterface

Add eth0 [10.134.1.7/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w

Unhealthy

Startup probe failed: Get "http://10.134.1.3:15021/healthz/ready": dial tcp 10.134.1.3:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w

ProbeError

Startup probe error: Get "http://10.134.1.3:15021/healthz/ready": dial tcp 10.134.1.3:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c52ec7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c52ec7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-551d0b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-551d0b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c52ec7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c52ec7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-a-8862aa-openshift-default-65c476f4d7

SuccessfulCreate

Created pod: e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

openshift-ingress

replicaset-controller

e2e-inf-a-8862aa-openshift-default-65c476f4d7

SuccessfulCreate

Created pod: e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

openshift-ingress

deployment-controller

e2e-inf-a-8862aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-8862aa-openshift-default-65c476f4d7 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8862aa-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

Started

Container started

openshift-ingress

multus

e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

Created

Container created

openshift-ingress

multus

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

AddedInterface

Add eth0 [10.132.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

Unhealthy

Startup probe failed: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

ProbeError

Startup probe error: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

Unhealthy

Startup probe failed: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

ProbeError

Startup probe error: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

Unhealthy

Startup probe failed: Get "http://10.134.1.4:15021/healthz/ready": dial tcp 10.134.1.4:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

ProbeError

Startup probe error: Get "http://10.134.1.4:15021/healthz/ready": dial tcp 10.134.1.4:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8862aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8862aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-b-f37ca7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f37ca7

openshift-ingress

replicaset-controller

e2e-inf-b-f37ca7-openshift-default-8f7fb5559

SuccessfulCreate

Created pod: e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

openshift-ingress

deployment-controller

e2e-inf-b-f37ca7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f37ca7-openshift-default-8f7fb5559 from 0 to 1

openshift-ingress

multus

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

AddedInterface

Add eth0 [10.134.1.8/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-551d0b-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-551d0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-551d0b-openshift-default-57c5b6c45f from 1 to 3

openshift-ingress

replicaset-controller

e2e-inf-b-551d0b-openshift-default-57c5b6c45f

SuccessfulCreate

Created pod: e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6

openshift-ingress

replicaset-controller

e2e-inf-b-551d0b-openshift-default-57c5b6c45f

SuccessfulCreate

Created pod: e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6

Created

Container created

openshift-ingress

multus

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

AddedInterface

Add eth0 [10.134.1.9/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

Started

Container started

openshift-ingress

multus

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f37ca7: serviceaccount "payload-processing-e2e-inf-b-f37ca7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-d64ml

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-f37ca7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f37ca7-85fcd85f88

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-f37ca7-85fcd85f88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f37ca7: serviceaccount "payload-processing-e2e-inf-b-f37ca7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f37ca7-85fcd85f88

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-f37ca7-85fcd85f88-xc8cv

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-f37ca7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-f37ca7-85fcd85f88 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f37ca7-85fcd85f88-xc8cv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f37ca7-85fcd85f88-xc8cv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-f37ca7-85fcd85f88-xc8cv

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f37ca7-85fcd85f88-xc8cv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-d64ml

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-d64ml

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-d64ml

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-d64ml

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

Unhealthy

Readiness probe failed: Get "http://10.133.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

ProbeError

Readiness probe error: Get "http://10.133.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8862aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8862aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6

Unhealthy

Startup probe failed: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

Unhealthy

Startup probe failed: Get "http://10.134.1.9:15021/healthz/ready": dial tcp 10.134.1.9:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6

ProbeError

Startup probe error: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

ProbeError

Startup probe error: Get "http://10.134.1.9:15021/healthz/ready": dial tcp 10.134.1.9:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

ProbeError

Startup probe error: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

Unhealthy

Startup probe failed: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f37ca7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f37ca7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-551d0b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-551d0b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-inf-a-2820d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2820d9

openshift-ingress

deployment-controller

e2e-inf-a-2820d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2820d9-openshift-default-7b898bbd45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-2820d9-openshift-default-7b898bbd45

SuccessfulCreate

Created pod: e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

openshift-ingress

multus

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-2820d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-2820d9-585c885cb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2820d9-787bf5fb78

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-2820d9-787bf5fb78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2820d9: serviceaccount "payload-processing-e2e-inf-a-2820d9" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2820d9-585c885cb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2820d9: serviceaccount "payload-processing-e2e-inf-a-2820d9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-2820d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-2820d9-787bf5fb78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2820d9-787bf5fb78

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-2820d9-787bf5fb78-bh47p

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2820d9-585c885cb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-t98wq

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-t98wq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2820d9-787bf5fb78-bh47p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-t98wq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-t98wq

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-t98wq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2820d9-787bf5fb78-bh47p

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-2820d9-787bf5fb78-bh47p

AddedInterface

Add eth0 [10.133.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2820d9-787bf5fb78-bh47p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9

AddedInterface

Add eth0 [10.134.1.14/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-861bb3-openshift-default-547b4c86df

SuccessfulCreate

Created pod: e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-551d0b-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-861bb3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-861bb3-openshift-default-547b4c86df from 1 to 2

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9

Created

Container created

openshift-ingress

multus

e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

AddedInterface

Add eth0 [10.133.0.225/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9

AddedInterface

Add eth0 [10.133.0.226/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-551d0b-openshift-default-57c5b6c45f

SuccessfulCreate

Created pod: e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-b-551d0b-openshift-default-57c5b6c45f

SuccessfulCreate

Created pod: e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-861bb3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-551d0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-551d0b-openshift-default-57c5b6c45f from 3 to 5

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9

Started

Container started

openshift-ingress

deployment-controller

e2e-inf-a-869b55-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-869b55-openshift-default-675f9b4749 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-869b55

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-869b55

openshift-ingress

replicaset-controller

e2e-inf-a-869b55-openshift-default-675f9b4749

SuccessfulCreate

Created pod: e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw
(x7)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9

ProbeError

Startup probe error: Get "http://10.134.1.14:15021/healthz/ready": dial tcp 10.134.1.14:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9

Unhealthy

Startup probe failed: Get "http://10.133.0.226:15021/healthz/ready": dial tcp 10.133.0.226:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9

Unhealthy

Startup probe failed: Get "http://10.134.1.14:15021/healthz/ready": dial tcp 10.134.1.14:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

ProbeError

Startup probe error: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

Unhealthy

Startup probe failed: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9

ProbeError

Startup probe error: Get "http://10.133.0.226:15021/healthz/ready": dial tcp 10.133.0.226:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

AddedInterface

Add eth0 [10.134.1.15/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-869b55

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-869b55-7f5bdf58fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-869b55-7f5bdf58fd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-869b55-7f5bdf58fd-q7l8v
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-869b55-b745cd4f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-869b55: serviceaccount "payload-processing-e2e-inf-a-869b55" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-869b55-b745cd4f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-7smvc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-869b55-7f5bdf58fd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-869b55-7f5bdf58fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-869b55: serviceaccount "payload-processing-e2e-inf-a-869b55" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-869b55

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-869b55-b745cd4f5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-869b55-7f5bdf58fd-q7l8v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-7smvc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-7smvc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-7smvc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-7smvc

AddedInterface

Add eth0 [10.134.1.16/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-869b55-7f5bdf58fd-q7l8v

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-869b55-7f5bdf58fd-q7l8v

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-869b55-7f5bdf58fd-q7l8v

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

Unhealthy

Readiness probe failed: Get "http://10.134.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

ProbeError

Readiness probe error: Get "http://10.134.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

ProbeError

Startup probe error: Get "http://10.134.1.8:15021/healthz/ready": dial tcp 10.134.1.8:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

Unhealthy

Startup probe failed: Get "http://10.134.1.8:15021/healthz/ready": dial tcp 10.134.1.8:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f37ca7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f37ca7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2820d9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2820d9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

ProbeError

Startup probe error: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

Unhealthy

Startup probe failed: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2820d9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2820d9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9f6b7c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9f6b7c

openshift-ingress

replicaset-controller

e2e-inf-b-9f6b7c-openshift-default-98b5bc999

SuccessfulCreate

Created pod: e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t

openshift-ingress

deployment-controller

e2e-inf-b-9f6b7c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9f6b7c-openshift-default-98b5bc999 from 0 to 1

openshift-ingress

multus

e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t

AddedInterface

Add eth0 [10.134.1.17/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9f6b7c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9f6b7c: serviceaccount "payload-processing-e2e-inf-b-9f6b7c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb-fh4tt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-jrdl6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9f6b7c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9f6b7c: serviceaccount "payload-processing-e2e-inf-b-9f6b7c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb-fh4tt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb-fh4tt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-jrdl6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-jrdl6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb-fh4tt

AddedInterface

Add eth0 [10.133.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb-fh4tt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-jrdl6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-jrdl6

AddedInterface

Add eth0 [10.133.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-t7sdc

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-921450-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-921450-openshift-default-7b67445fff

SuccessfulDelete

Deleted pod: e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-7jqjz

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7jqjz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-76597d6855 from 10 to 7

openshift-ingress

deployment-controller

e2e-worker-w0-921450-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-921450-openshift-default-7b67445fff from 2 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-wwft7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vfhk2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f37ca7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-f37ca7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f37ca7-openshift-default-8f7fb5559 from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-b-f37ca7-openshift-default-8f7fb5559

SuccessfulCreate

Created pod: e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml

openshift-ingress

multus

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml

ProbeError

Startup probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml

Unhealthy

Startup probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-daf3ba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-daf3ba

openshift-ingress

deployment-controller

e2e-inf-b-daf3ba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-daf3ba-openshift-default-68fbcb9679 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-daf3ba-openshift-default-68fbcb9679

SuccessfulCreate

Created pod: e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz

openshift-ingress

multus

e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz

AddedInterface

Add eth0 [10.133.0.232/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-869b55-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

ProbeError

Startup probe error: Get "http://10.134.1.15:15021/healthz/ready": dial tcp 10.134.1.15:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

Unhealthy

Startup probe failed: Get "http://10.134.1.15:15021/healthz/ready": dial tcp 10.134.1.15:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-869b55-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8862aa-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-a-8862aa-openshift-default-65c476f4d7

SuccessfulDelete

Deleted pod: e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

openshift-ingress

deployment-controller

e2e-inf-a-8862aa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-inf-a-8862aa-openshift-default-65c476f4d7 from 3 to 2

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-x6mxg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-daf3ba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-daf3ba-766f4d7b84 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-9rrgg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-daf3ba: serviceaccount "payload-processing-e2e-inf-b-daf3ba" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-daf3ba-766f4d7b84

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-daf3ba-766f4d7b84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-daf3ba: serviceaccount "payload-processing-e2e-inf-b-daf3ba" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-daf3ba-766f4d7b84

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-daf3ba-766f4d7b84-bnhf6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-daf3ba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-9rrgg

AddedInterface

Add eth0 [10.133.0.235/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-daf3ba-766f4d7b84-bnhf6

AddedInterface

Add eth0 [10.133.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-daf3ba-766f4d7b84-bnhf6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-9rrgg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-daf3ba-766f4d7b84-bnhf6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-9rrgg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-9rrgg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-daf3ba-766f4d7b84-bnhf6

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-869b55-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-869b55-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-6wq4j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0cc6b1-58d46575d-ww7q2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9f6b7c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9f6b7c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t

Unhealthy

Startup probe failed: Get "http://10.134.1.17:15021/healthz/ready": dial tcp 10.134.1.17:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t

ProbeError

Startup probe error: Get "http://10.134.1.17:15021/healthz/ready": dial tcp 10.134.1.17:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0cc6b1-68b845fc95-6wq4j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0cc6b1-58d46575d-ww7q2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9f6b7c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9f6b7c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7

SuccessfulDelete

Deleted pod: e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-rvgh8

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-de7e3a-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-de7e3a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-de7e3a-openshift-default-557f55b6c7 from 2 to 1

openshift-ingress

kubelet

e2e-inf-a-0cc6b1-openshift-default-7844696f7-7lfqr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c52ec7-f6884465b-465q7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-zvsc8

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz

ProbeError

Startup probe error: Get "http://10.133.0.232:15021/healthz/ready": dial tcp 10.133.0.232:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz

Unhealthy

Startup probe failed: Get "http://10.133.0.232:15021/healthz/ready": dial tcp 10.133.0.232:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-551d0b-openshift-default-57c5b6c45f

SuccessfulDelete

Deleted pod: e2e-inf-b-551d0b-openshift-default-57c5b6c45f-rz466

openshift-ingress

deployment-controller

e2e-inf-b-551d0b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-inf-b-551d0b-openshift-default-57c5b6c45f from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-551d0b-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-2pbp9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-5hmsm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-45dc34-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-45dc34-openshift-default-84944d9ff from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-45dc34-openshift-default-84944d9ff

SuccessfulDelete

Deleted pod: e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-45dc34-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-p6n4s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-p6n4s

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-380c08-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-380c08-openshift-default-598cf58675 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-380c08-openshift-default-598cf58675

SuccessfulDelete

Deleted pod: e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-380c08-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-d82e82-openshift-default-58686789bf

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-d82e82-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w1-d82e82-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-d82e82-openshift-default-58686789bf from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-daf3ba-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-nqmgx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-daf3ba-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-bg9v6

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-2d5ll

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-c52ec7-openshift-default-78bf6c4c47-mj78w

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c52ec7-f6884465b-465q7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c52ec7-6977fb4447-zvsc8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-8b8e54-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85

SuccessfulDelete

Deleted pod: e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-7jp6m

openshift-ingress

deployment-controller

e2e-extmod-b-8b8e54-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85 from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-daf3ba-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-daf3ba-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1aa59a-5f69877548-fppdt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-s9pmv

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-extmod-a-861bb3-openshift-default-547b4c86df

SuccessfulDelete

Deleted pod: e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-f9ggr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-861bb3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-861bb3-openshift-default-547b4c86df from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-861bb3-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1aa59a-765b7b94b7-s9pmv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1aa59a-5f69877548-fppdt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-8ln4k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8862aa-55748dd5d8-slvct

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-1aa59a-openshift-default-579999c475-nfnl2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-76597d6855 from 4 to 8
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8862aa-7d764b8787-8ln4k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-7lhc4

AddedInterface

Add eth0 [10.133.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7lhc4

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-dxjft

AddedInterface

Add eth0 [10.133.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-dxjft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-dxjft

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-dxjft

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7lhc4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-76h9j

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-76h9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-76h9j

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-qwf7s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7lhc4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-qwf7s

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-76h9j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-xtrvj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-qwf7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-551d0b-6686dd876d-qvsgq

Killing

Stopping container payload-processing

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-qwf7s

AddedInterface

Add eth0 [10.134.1.42/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-qwf7s

Unhealthy

Startup probe failed: Get "http://10.134.1.42:15021/healthz/ready": dial tcp 10.134.1.42:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-76h9j

ProbeError

Startup probe error: Get "http://10.132.1.10:15021/healthz/ready": dial tcp 10.132.1.10:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-76h9j

Unhealthy

Startup probe failed: Get "http://10.132.1.10:15021/healthz/ready": dial tcp 10.132.1.10:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7lhc4

Unhealthy

Startup probe failed: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-qwf7s

ProbeError

Startup probe error: Get "http://10.134.1.42:15021/healthz/ready": dial tcp 10.134.1.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7lhc4

ProbeError

Startup probe error: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-dxjft

Unhealthy

Startup probe failed: Get "http://10.133.1.2:15021/healthz/ready": dial tcp 10.133.1.2:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-dxjft

ProbeError

Startup probe error: Get "http://10.133.1.2:15021/healthz/ready": dial tcp 10.133.1.2:15021: connect: connection refused body:
(x12)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 10; reason: All metrics below target
(x12)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-76597d6855 from 8 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-tpnm7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkggb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-xkggb

AddedInterface

Add eth0 [10.134.1.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkggb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-tpnm7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-tpnm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-76597d6855-tpnm7

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkggb

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-551d0b-6686dd876d-qvsgq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-551d0b-78b87bfb99-xtrvj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkggb

ProbeError

Startup probe error: Get "http://10.134.1.43:15021/healthz/ready": dial tcp 10.134.1.43:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-tpnm7

ProbeError

Startup probe error: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-tpnm7

Unhealthy

Startup probe failed: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkggb

Unhealthy

Startup probe failed: Get "http://10.134.1.43:15021/healthz/ready": dial tcp 10.134.1.43:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-qgxv5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-8862aa-openshift-default-65c476f4d7-7kxhm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-d64ml

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f37ca7-85fcd85f88-xc8cv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f37ca7-859dd99c87-d64ml

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-9kzp7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-cljg9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-4rzg6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-551d0b-openshift-default-57c5b6c45f-62sf9

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

replicaset-controller

e2e-inf-b-f37ca7-openshift-default-8f7fb5559

FailedCreate

Error creating: pods "e2e-inf-b-f37ca7-openshift-default-8f7fb5559-" is forbidden: error looking up service account openshift-ingress/e2e-inf-b-f37ca7-openshift-default: serviceaccount "e2e-inf-b-f37ca7-openshift-default" not found

openshift-ingress

deployment-controller

e2e-inf-b-f37ca7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f37ca7-openshift-default-8f7fb5559 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-xj7sd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-f37ca7-openshift-default-8f7fb5559-889ml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2820d9-787bf5fb78-bh47p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-t98wq

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-mt-15e8827b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-15e8827b-openshift-default-8cc99c85c from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-15e8827b-openshift-default-8cc99c85c

SuccessfulCreate

Created pod: e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg

openshift-ingress

gateway_labeler_controller

e2e-mt-15e8827b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-15e8827b

openshift-ingress

multus

e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg

AddedInterface

Add eth0 [10.134.1.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2820d9-585c885cb7-t98wq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-15e8827b-787b47bbf6

SuccessfulCreate

Created pod: payload-processing-e2e-mt-15e8827b-787b47bbf6-tclcb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-15e8827b-55679df55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-15e8827b-55679df55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-15e8827b: serviceaccount "payload-processing-e2e-mt-15e8827b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-15e8827b-787b47bbf6

FailedCreate

Error creating: pods "payload-processing-e2e-mt-15e8827b-787b47bbf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-15e8827b: serviceaccount "payload-processing-e2e-mt-15e8827b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-15e8827b-55679df55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-15e8827b-55679df55-xq5t6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-15e8827b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-15e8827b-55679df55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-15e8827b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-15e8827b-787b47bbf6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-15e8827b-55679df55-xq5t6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-15e8827b-787b47bbf6-tclcb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-15e8827b-55679df55-xq5t6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-15e8827b-55679df55-xq5t6

AddedInterface

Add eth0 [10.133.1.10/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-15e8827b-787b47bbf6-tclcb

AddedInterface

Add eth0 [10.133.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-15e8827b-55679df55-xq5t6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-15e8827b-787b47bbf6-tclcb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-15e8827b-787b47bbf6-tclcb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-869b55-7f5bdf58fd-q7l8v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-7smvc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-869b55-openshift-default-675f9b4749-2l7bw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-869b55-b745cd4f5-7smvc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-869b55-7f5bdf58fd-q7l8v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-dxjft

ProbeError

Readiness probe error: Get "http://10.133.1.2:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-dxjft

Unhealthy

Readiness probe failed: Get "http://10.133.1.2:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

ProbeError

Readiness probe error: Get "http://10.134.0.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

Unhealthy

Readiness probe failed: Get "http://10.134.0.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-9rrgg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-daf3ba-766f4d7b84-bnhf6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-2820d9-openshift-default-7b898bbd45-f22vs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9f6b7c-59d7fd9cb-fh4tt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-jrdl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-daf3ba-openshift-default-68fbcb9679-hlwgz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-daf3ba-7d69f954dc-9rrgg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9f6b7c-549554d7c9-jrdl6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-9f6b7c-openshift-default-98b5bc999-tcq4t

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-15e8827b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-15e8827b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg

ProbeError

Startup probe error: Get "http://10.134.1.46:15021/healthz/ready": dial tcp 10.134.1.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg

Unhealthy

Startup probe failed: Get "http://10.134.1.46:15021/healthz/ready": dial tcp 10.134.1.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-nt76m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-hz7nk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-861bb3-589555cc9b-k659d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-c4k7q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-861bb3-openshift-default-547b4c86df-xqplg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-15e8827b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-15e8827b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2107d4-7588cd98bc-nt76m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2107d4-7bf5b8d588-hz7nk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-861bb3-7bb884bf79-c4k7q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6018b4-f55df5fb8-4gsb2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-861bb3-589555cc9b-k659d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-r5frb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-6018b4-openshift-default-7fd78b55cc-pl28q

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6018b4-6868d8bb99-r5frb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6018b4-f55df5fb8-4gsb2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-798lh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-ms29d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-2107d4-openshift-default-659d97db85-l4lxk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-38e0db-674844768b-xkbkd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-sjkjz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e95c51-7958f9fdcf-798lh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e95c51-6b68cbff46-ms29d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-38e0db-openshift-default-559cb7d8df-6jhrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-15e8827b-55679df55-xq5t6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-15e8827b-787b47bbf6-tclcb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-38e0db-674844768b-xkbkd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-38e0db-675d6bc647-sjkjz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-jbckm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-wzn42

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-e95c51-openshift-default-7958f47665-x9mbq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-dtq2s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-pmqhf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ab244c-58d8bddb46-wzn42

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ab244c-7659db958c-jbckm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-mt-15e8827b-openshift-default-8cc99c85c-r7bgg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w4-24b124-openshift-default-77557bb57f

SuccessfulCreate

Created pod: e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-24b124-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w4-24b124-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-24b124-openshift-default-77557bb57f from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t

Created

Container created

openshift-ingress

multus

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t

AddedInterface

Add eth0 [10.133.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-d82e82-7d456c8bbc-pmqhf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-d82e82-fdf98fb94-dtq2s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-ab244c-openshift-default-694869f597-mrkjm

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t

ProbeError

Startup probe error: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t

Unhealthy

Startup probe failed: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-skjjq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-wk8g4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-d82e82-openshift-default-58686789bf-djgfv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-380c08-65f99966c6-8p2v9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-380c08-67478544f9-4pdqp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4a7508-6f5b58db4b-skjjq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4a7508-78598dfc9f-wk8g4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-4a7508-openshift-default-546fcc75b9-zb7dr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-380c08-67478544f9-4pdqp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-380c08-65f99966c6-8p2v9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-99nqx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-mlkk9

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67

SuccessfulCreate

Created pod: e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-09ef1d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w2-09ef1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67 from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

AddedInterface

Add eth0 [10.133.1.30/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

Unhealthy

Startup probe failed: Get "http://10.133.1.30:15021/healthz/ready": dial tcp 10.133.1.30:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

ProbeError

Startup probe error: Get "http://10.133.1.30:15021/healthz/ready": dial tcp 10.133.1.30:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-de7e3a-7b788bbfd6-mlkk9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-de7e3a-6768cfb995-99nqx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-380c08-openshift-default-598cf58675-wrmvc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-d74mc

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-d74mc

Killing

Stopping container discovery

openshift-ingress

kubelet

e2e-worker-w3-de7e3a-openshift-default-557f55b6c7-hv9dr

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7616-aaf25a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7616-aaf25a

AddedInterface

Add eth0 [10.133.1.34/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7616-aaf25a

Created

Container created

opendatahub

kubelet

test-curl-7616-aaf25a

Started

Container started

opendatahub

kubelet

test-curl-7616-ac3d93

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7616-aaf25a

Killing

Stopping container test-curl-7616-aaf25a

opendatahub

multus

test-curl-7616-ac3d93

AddedInterface

Add eth0 [10.133.1.35/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7616-ac3d93

Created

Container created

opendatahub

kubelet

test-curl-7616-ac3d93

Started

Container started

opendatahub

kubelet

test-curl-7616-ac3d93

Killing

Stopping container test-curl-7616-ac3d93

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1c4bcd-55d686745d-4hhzp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-q4ttx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7

SuccessfulCreate

Created pod: e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-b-w0-c095fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-c095fa-openshift-default-756895fbf7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c095fa-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh

AddedInterface

Add eth0 [10.133.1.40/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh

ProbeError

Startup probe error: Get "http://10.133.1.40:15021/healthz/ready": dial tcp 10.133.1.40:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh

Unhealthy

Startup probe failed: Get "http://10.133.1.40:15021/healthz/ready": dial tcp 10.133.1.40:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-z2dn9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-76h9j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-x2rr2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-xkggb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-76597d6855 from 10 to 5
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-xkggb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-qwf7s

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1c4bcd-76ffbffdcf-q4ttx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1c4bcd-55d686745d-4hhzp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

Unhealthy

Readiness probe failed: Get "http://10.134.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-z2dn9

ProbeError

Readiness probe error: Get "http://10.134.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-1c4bcd-openshift-default-847756f8fc-q75rq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-88bvg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d1a330-86c85f76d-mhswn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-713dc8-798785c495-lqlhs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-713dc8-7d557467f6-5nq4t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-nl5nn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-j8v2w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-d1a330-openshift-default-5f66d94d4f-chz78

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d1a330-86c85f76d-mhswn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d1a330-6645f788c9-88bvg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-713dc8-openshift-default-84c5dbdfb9-lqbhn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-713dc8-7d557467f6-5nq4t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-tlrg5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6babca-6dc6645cb4-jw8l5

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-713dc8-798785c495-lqlhs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-8b8e54-7b688ffbbc-nl5nn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-8b8e54-77dc6fdfc4-j8v2w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-39c99d-b5cd68c79-ltfgp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-39c99d-57d5954c5b-cv4v2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-8b8e54-openshift-default-7c4ff64b85-kfncm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6babca-6dc6645cb4-jw8l5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6babca-6f69b7f9-tlrg5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-jxlmq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-1a2436-567f469f4-qmp5p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-39c99d-openshift-default-5c9b64c6d5-4d6mn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-6babca-openshift-default-cb56dc55c-v9rvm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-4xv4f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-675070-5bf74cf574-r4wfr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-xxv8l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-fskbl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-1a2436-7676957859-jxlmq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-1a2436-openshift-default-84b85bb969-kqc5c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-1a2436-567f469f4-qmp5p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-gcv88

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-rgb5c

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-675070-5bf74cf574-r4wfr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-675070-7d6bd9bf67-4xv4f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-675070-openshift-default-8b45bc97-jxjr4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-236fc4-6c5fd847b7-xxv8l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-236fc4-88f5755fb-fskbl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-rvhxf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-236fc4-openshift-default-7f5d4cd5f9-mx2gs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-5snxw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-lvpxv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-rgj6w

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-24b124-b67d5558c-gcv88

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-24b124-6454ddcf88-rgb5c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-kmj4t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-24b124-openshift-default-77557bb57f-qlr4t

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-09ef1d-589d79476c-5snxw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-09ef1d-54757db89b-rvhxf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-mh2fk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jddrp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-c095fa-openshift-default-756895fbf7-jdrgh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-09ef1d-openshift-default-65bb585f67-79744

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c095fa-5d479bd6f9-rgj6w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c095fa-7ff45cdc78-lvpxv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-45dc34-79f9556b56-st7qr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-rqxz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-bl75c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fe1374-65cf8c997d-5j2vz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-921450-8d6546c9b-5pxxc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-xs76b

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-45dc34-d7f945cff-rqxz2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fe1374-5c8465bf67-bl75c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-45dc34-openshift-default-84944d9ff-4jdpj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-921450-7f64fb4c79-xs76b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-921450-8d6546c9b-5pxxc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-fe1374-openshift-default-5dc59487b5-nvjxm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-921450-openshift-default-7b67445fff-vq47j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-76597d6855 from 5 to 3

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-76597d6855

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-76597d6855-7lhc4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-dxjft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-76597d6855-7lhc4

Killing

Stopping container istio-proxy