Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3627d700-796cffd94-gbs8r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3627d700-796cffd94-gbs8r to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-93c22e-55546fbb88-9nmfw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-93c22e-55546fbb88-9nmfw to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx to ip-10-0-136-123.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-5mhqr to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-bbd0e5-64d48998dd-ngp6k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-bbd0e5-64d48998dd-ngp6k to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt to ip-10-0-136-123.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-m45vq

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-m45vq to ip-10-0-131-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-5nt9s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-5nt9s to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-520bc4-59bf859948-fn4xc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-520bc4-59bf859948-fn4xc to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95-vx5bm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95-vx5bm to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-zmfxz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-zmfxz to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-6g2sk to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6-dmn9k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6-dmn9k to ip-10-0-128-31.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-cfmlr

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-cfmlr to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ba44b248-868467698b-kfvjh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ba44b248-868467698b-kfvjh to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ba44b248-868467698b-2z4nc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ba44b248-868467698b-2z4nc to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-7t4cd to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-q746s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-q746s to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-4dd310-555f786c8-v5rcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-4dd310-555f786c8-v5rcr to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-9jxv8 to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-5a6371-84f5455bfb-fkrt4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-5a6371-84f5455bfb-fkrt4 to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-b9r4c to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g to ip-10-0-131-226.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-bqddx

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-bqddx to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-798193ae-66b87c8994-w7jsx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-798193ae-66b87c8994-w7jsx to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67-qhcgf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67-qhcgf to ip-10-0-131-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-54g5w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-54g5w to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-a035a3-557b7d66b8-cd2hn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-a035a3-557b7d66b8-cd2hn to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7-9lnl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7-9lnl6 to ip-10-0-136-123.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-4gvmg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4gvmg to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc-r4f97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc-r4f97 to ip-10-0-128-31.ec2.internal

kuadrant-system

authorino-57f7f8659f-hmcmc

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-hmcmc to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-fmjhk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-fmjhk to ip-10-0-136-123.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4fh4p to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b-lcq4w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b-lcq4w to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47-tvx78

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47-tvx78 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-ec27ed-5c6485859d-fxf9c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ec27ed-5c6485859d-fxf9c to ip-10-0-131-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-l5d6g to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg to ip-10-0-128-31.ec2.internal

kuadrant-system

authorino-674cd869b7-wvxv5

Scheduled

Successfully assigned kuadrant-system/authorino-674cd869b7-wvxv5 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-f6a022-597b4db76-hf2jj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f6a022-597b4db76-hf2jj to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk to ip-10-0-136-123.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-mlqh8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-mlqh8 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-47czd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-47czd to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-nnt77

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-nnt77 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-98djx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-98djx to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-q47h9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-q47h9 to ip-10-0-131-226.ec2.internal

kuadrant-system

authorino-6889cbd8c4-5ls5l

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-5ls5l to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6 to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-qtzdf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-qtzdf to ip-10-0-131-226.ec2.internal

kuadrant-system

authorino-6f6944bcdd-rmd8t

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-rmd8t to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c-zql6j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c-zql6j to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rrwcn to ip-10-0-131-226.ec2.internal

kuadrant-system

authorino-b4cbf4fd4-7wnrx

Scheduled

Successfully assigned kuadrant-system/authorino-b4cbf4fd4-7wnrx to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-2q89w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-2q89w to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68-7w5m9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68-7w5m9 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-2ltk7 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4-cgd7c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4-cgd7c to ip-10-0-128-31.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-9s8vq

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-9s8vq to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-28h4s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-28h4s to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r to ip-10-0-128-31.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-s6zsz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-s6zsz to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-8km4m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-8km4m to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667-hlgh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667-hlgh5 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-jq6b2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-jq6b2 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-bc5d8f-755ff454bd-zz2pm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-bc5d8f-755ff454bd-zz2pm to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-w8ll9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-w8ll9 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-zpmgn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-zpmgn to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467-qjtc5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467-qjtc5 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr to ip-10-0-128-31.ec2.internal

openshift-ingress

kube-auth-proxy-5c4bb65c68-z6847

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5c4bb65c68-z6847 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a55a4b-b845dbd76-dgs6l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a55a4b-b845dbd76-dgs6l to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-sp6f7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-sp6f7 to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-7g7mz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-7g7mz to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9 to ip-10-0-131-226.ec2.internal

openshift-ingress

kube-auth-proxy-5c4bb65c68-jwxlp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5c4bb65c68-jwxlp to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979-tw8gm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979-tw8gm to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-a519e9-8c464697d-gpjt7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-a519e9-8c464697d-gpjt7 to ip-10-0-136-123.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-g5mql

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-g5mql to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a55a4b-665d74b76b-6rnkx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a55a4b-665d74b76b-6rnkx to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8 to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8272af-7979ff4776-bqhjl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8272af-7979ff4776-bqhjl to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8272af-64c9997f4b-8kzwk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8272af-64c9997f4b-8kzwk to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84-5t78j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84-5t78j to ip-10-0-128-31.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-scslz

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-scslz to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79-nr2z9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79-nr2z9 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f50f6e-64658675d-lxsrv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f50f6e-64658675d-lxsrv to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-584c9d-744b84fc6b-82z82

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-584c9d-744b84fc6b-82z82 to ip-10-0-131-226.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-bwccj

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-bwccj to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-584c9d-5947df7d8-g6p5b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-584c9d-5947df7d8-g6p5b to ip-10-0-131-226.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-f5g5p

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-f5g5p to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2 to ip-10-0-128-31.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-7kz9s

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7kz9s to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb-ddn7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb-ddn7f to ip-10-0-128-31.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-hbpn7

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-hbpn7 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n to ip-10-0-128-31.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-js6cr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-js6cr to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-532f3b-65596d649b-6cng2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-532f3b-65596d649b-6cng2 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-hs88d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-hs88d to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-hfqfr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-hfqfr to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-33c99c-fbb7dd756-l8bj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-33c99c-fbb7dd756-l8bj7 to ip-10-0-128-31.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-jl6p5

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-jl6p5 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65 to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-mh9zb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-mh9zb to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-9xqfx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-9xqfx to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-mkdnv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-mkdnv to ip-10-0-128-31.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-856b6dffcf-lmck7

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-856b6dffcf-lmck7 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c-s8wxt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c-s8wxt to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-33c99c-5f5c495f66-hmmgf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-33c99c-5f5c495f66-hmmgf to ip-10-0-131-226.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-66g66

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-66g66 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-be48b4-6f5ccbbf64-9rmpp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-be48b4-6f5ccbbf64-9rmpp to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-b66aad-6b96d78f98-zlkbj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b66aad-6b96d78f98-zlkbj to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a5f459-77df44f7fd-zg4q2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a5f459-77df44f7fd-zg4q2 to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-89f101-786b784bfb-sppfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-89f101-786b784bfb-sppfr to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-b22a13-59d6b5f474-sxgb4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-b22a13-59d6b5f474-sxgb4 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-8baf7e-5b76fb7786-mb5vr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-8baf7e-5b76fb7786-mb5vr to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-62efb8-74d8fbfd66-2gbn2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-62efb8-74d8fbfd66-2gbn2 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1c148a-69b6466f68-4557l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1c148a-69b6466f68-4557l to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-c44730-7cb74987b-2q97s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-c44730-7cb74987b-2q97s to ip-10-0-136-123.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-thdmg

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-thdmg to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-a0083e-d588694d8-kzrwp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-a0083e-d588694d8-kzrwp to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-6d1778-649f5db87b-kqr6w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-6d1778-649f5db87b-kqr6w to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-69f3fa-584957b64d-7cdxt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-69f3fa-584957b64d-7cdxt to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-2d8df2-668896bb8b-wg5j8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-2d8df2-668896bb8b-wg5j8 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-f0145f-78879f4dd-8cbb4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-f0145f-78879f4dd-8cbb4 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-ncd8b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-ncd8b to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-ad1661-7949885446-5w8j8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ad1661-7949885446-5w8j8 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-88acce-545647888d-gd22r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-88acce-545647888d-gd22r to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-2d2923-6d6d74576d-l294v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-2d2923-6d6d74576d-l294v to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-3bbfc8-7fdcdbf498-7zzq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-3bbfc8-7fdcdbf498-7zzq2 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-autores-a88d7d-7d7f79555b-gkqr7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-a88d7d-7d7f79555b-gkqr7 to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-fe108e-6d695b9794-ftnff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-fe108e-6d695b9794-ftnff to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9 to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f7a606-6f7fd6cf96-pcpbw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f7a606-6f7fd6cf96-pcpbw to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8 to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f789d7-84df74b86b-tqn5j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f789d7-84df74b86b-tqn5j to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj to ip-10-0-131-226.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-f6hfd

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-f6hfd to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-31407e-78c4f67fb8-nkhjz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-31407e-78c4f67fb8-nkhjz to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e6df62-cd88fc896-qzpvw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e6df62-cd88fc896-qzpvw to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c15d3a-67bdf8c648-smxp7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c15d3a-67bdf8c648-smxp7 to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-1ec766-77bd9f9458-ls5rl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1ec766-77bd9f9458-ls5rl to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-0fab6d-798fc6fdb4-82s44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-0fab6d-798fc6fdb4-82s44 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c45a2ff8-875d9b65b-k9mff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c45a2ff8-875d9b65b-k9mff to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9c94fbc2-9c7c645f4-dnpds

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9c94fbc2-9c7c645f4-dnpds to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-ait-55140dc4-8b8949786-lshn2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-55140dc4-8b8949786-lshn2 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1ec766-openshift-default-69f8887585-55l2h to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-f26kj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-f26kj to ip-10-0-136-123.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-q92kk

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-q92kk to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf-jq79g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf-jq79g to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c-nnkrt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c-nnkrt to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-hpphs

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-hpphs to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc-zq8v9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc-zq8v9 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-jsnh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-jsnh9 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499-d8msd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499-d8msd to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-c7m7g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-c7m7g to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-v6pxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-v6pxh to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-pfkgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-pfkgg to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-a519e9-7b75656447-pgbsg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-a519e9-7b75656447-pgbsg to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz to ip-10-0-136-123.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-ds65s

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-ds65s to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1ec766-745546f55f-9t8z9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1ec766-745546f55f-9t8z9 to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-n2wxw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-n2wxw to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-xj5b7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-xj5b7 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-vgdqq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-vgdqq to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-9lzbh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-9lzbh to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7-fprtw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7-fprtw to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-b97d5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-b97d5 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-d7bll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-d7bll to ip-10-0-131-226.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-l7s2w

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-l7s2w to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-zhhc9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-zhhc9 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e6df62-fd6b46799-ks5zx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e6df62-fd6b46799-ks5zx to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c-4tjvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c-4tjvd to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-48kw6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-48kw6 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f-zcw9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f-zcw9z to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-31407e-5969d8795-tl5rd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-31407e-5969d8795-tl5rd to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c-2mrrj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c-2mrrj to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455-5hlz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455-5hlz4 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc to ip-10-0-131-226.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hfhgh

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hfhgh to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795-9lp9p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795-9lp9p to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447-lx4lq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447-lx4lq to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-5a6371-86957fc887-7h9c5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-5a6371-86957fc887-7h9c5 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f789d7-7795658f8c-4h5s8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f789d7-7795658f8c-4h5s8 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555-ml7gb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555-ml7gb to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-tmbhl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-tmbhl to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55-4scp6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55-4scp6 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc to ip-10-0-131-226.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-5vzlj

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-5vzlj to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99-k9dns

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99-k9dns to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-7dprb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-7dprb to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55-q685s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55-q685s to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-798193ae-787bd8875-pml7v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-798193ae-787bd8875-pml7v to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6 to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs to ip-10-0-131-226.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-hmvkl

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-hmvkl to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667 to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ba44b248-d59758b87-4cn26

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ba44b248-d59758b87-4cn26 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b

Scheduled

Successfully assigned openshift-ingress/e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ba44b248-d59758b87-pj7z9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ba44b248-d59758b87-pj7z9 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6 to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g to ip-10-0-128-31.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx to ip-10-0-131-226.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-59cf4dc6bfrtd7t

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-59cf4dc6bfrtd7t to ip-10-0-128-31.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7f5db49b8c-xzzq4 to ip-10-0-128-31.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7f5db49b8c-mxrj6 to ip-10-0-136-123.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7f5db49b8c-kr798

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7f5db49b8c-kr798 to ip-10-0-131-226.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-wmwrb

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-wmwrb to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-dvknf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-dvknf to ip-10-0-128-31.ec2.internal

opendatahub

test-curl-7324-6ab4a8

Scheduled

Successfully assigned opendatahub/test-curl-7324-6ab4a8 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4 to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6 to ip-10-0-131-226.ec2.internal

models-as-a-service

payload-processing-external-model-54cb654cf-98j9x

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-54cb654cf-98j9x to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-8d44dd-f699bfc76-46t7w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-8d44dd-f699bfc76-46t7w to ip-10-0-128-31.ec2.internal

opendatahub

test-curl-7318-f1b6c5

Scheduled

Successfully assigned opendatahub/test-curl-7318-f1b6c5 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk to ip-10-0-128-31.ec2.internal

models-as-a-service

payload-processing-external-model-578778c84f-d5q7w

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-578778c84f-d5q7w to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt to ip-10-0-136-123.ec2.internal

opendatahub

test-curl-7318-884907

Scheduled

Successfully assigned opendatahub/test-curl-7318-884907 to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c to ip-10-0-128-31.ec2.internal

models-as-a-service

payload-processing-external-model-578778c84f-dvrdh

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-578778c84f-dvrdh to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2 to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf-86gjt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf-86gjt to ip-10-0-128-31.ec2.internal

opendatahub

test-curl-7318-22964b

Scheduled

Successfully assigned opendatahub/test-curl-7318-22964b to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-jkzsb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-jkzsb to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-m68pb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-m68pb to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-tv9f9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-tv9f9 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-84mwr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-84mwr to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7-8cxxl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7-8cxxl to ip-10-0-136-123.ec2.internal

models-as-a-service

payload-processing-external-model-58946db44c-tdkhz

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-58946db44c-tdkhz to ip-10-0-128-31.ec2.internal

opendatahub

test-curl-7315-c172b3

Scheduled

Successfully assigned opendatahub/test-curl-7315-c172b3 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-3627d700-74849467dc-497gz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3627d700-74849467dc-497gz to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq to ip-10-0-136-123.ec2.internal

cert-manager

cert-manager-597b95cb84-twlhp

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-twlhp to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw to ip-10-0-136-123.ec2.internal

opendatahub

test-curl-7315-9d5726

Scheduled

Successfully assigned opendatahub/test-curl-7315-9d5726 to ip-10-0-131-226.ec2.internal

models-as-a-service

payload-processing-external-model-5b5448f9b9-hx69p

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5b5448f9b9-hx69p to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-93c22e-6dff459747-tfd4r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-93c22e-6dff459747-tfd4r to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg to ip-10-0-131-226.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-59qn9

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-59qn9 to ip-10-0-131-226.ec2.internal

models-as-a-service

payload-processing-external-model-5b5448f9b9-k56kd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5b5448f9b9-k56kd to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c-rnmrm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c-rnmrm to ip-10-0-128-31.ec2.internal

opendatahub

test-curl-7315-69263c

Scheduled

Successfully assigned opendatahub/test-curl-7315-69263c to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-jn9z2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-jn9z2 to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-8pv7d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-8pv7d to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-mp68x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-mp68x to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-qxfgm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-qxfgm to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-zc52v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-zc52v to ip-10-0-128-31.ec2.internal

opendatahub

test-curl-7315-5c3a6d

Scheduled

Successfully assigned opendatahub/test-curl-7315-5c3a6d to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng to ip-10-0-128-31.ec2.internal

models-as-a-service

payload-processing-external-model-5cd7f677db-sqssr

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5cd7f677db-sqssr to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-7xtps

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-7xtps to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq to ip-10-0-128-31.ec2.internal

opendatahub

test-curl-7312-1a493a

Scheduled

Successfully assigned opendatahub/test-curl-7312-1a493a to ip-10-0-131-226.ec2.internal

opendatahub

odh-model-controller-769875db56-kjczm

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-kjczm to ip-10-0-131-226.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-wm62c

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-wm62c to ip-10-0-131-226.ec2.internal

opendatahub

maas-controller-786557dc8d-52sb6

Scheduled

Successfully assigned opendatahub/maas-controller-786557dc8d-52sb6 to ip-10-0-128-31.ec2.internal

models-as-a-service

payload-processing-external-model-65dff8f9bc-kxmrj

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-65dff8f9bc-kxmrj to ip-10-0-128-31.ec2.internal

opendatahub

maas-controller-5749bffc96-tr2hn

Scheduled

Successfully assigned opendatahub/maas-controller-5749bffc96-tr2hn to ip-10-0-131-226.ec2.internal

openshift-jobset-operator

jobset-controller-manager-576fcc8bf6-kq8bh

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-576fcc8bf6-kq8bh to ip-10-0-136-123.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-2lbgw

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-2lbgw to ip-10-0-131-226.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-5xns7

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-5xns7 to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-a88d7d-784b755d79-qvjj8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-a88d7d-784b755d79-qvjj8 to ip-10-0-136-123.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-mwq2b

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-mwq2b to ip-10-0-136-123.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-dd578

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-dd578 to ip-10-0-131-226.ec2.internal

models-as-a-service

payload-processing-external-model-6969648bc7-2r5xt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6969648bc7-2r5xt to ip-10-0-136-123.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-9z8hf

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-9z8hf to ip-10-0-136-123.ec2.internal

opendatahub

ai-gateway-controller-6577b95894-swx2g

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6577b95894-swx2g to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2 to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-aaf467-544d8fdc84-jjcv9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-aaf467-544d8fdc84-jjcv9 to ip-10-0-136-123.ec2.internal

models-as-a-service

payload-processing-external-model-6969648bc7-mwfbf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6969648bc7-mwfbf to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595-zhrs2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595-zhrs2 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n to ip-10-0-128-31.ec2.internal

openshift-ingress

router-default-5b994dfc85-2v9ww

Scheduled

Successfully assigned openshift-ingress/router-default-5b994dfc85-2v9ww to ip-10-0-128-31.ec2.internal

openshift-ingress

router-default-5b994dfc85-2v9ww

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-5b994dfc85-2v9ww

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx to ip-10-0-128-31.ec2.internal

models-as-a-service

payload-processing-external-model-69f585c47c-wkp5h

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-69f585c47c-wkp5h to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-2h2tp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-2h2tp to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n to ip-10-0-131-226.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-eaee88-544ddb87d6-cckhd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-eaee88-544ddb87d6-cckhd to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx to ip-10-0-136-123.ec2.internal

models-as-a-service

payload-processing-external-model-86546bfd69-st8c4

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-86546bfd69-st8c4 to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c to ip-10-0-136-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c-p2rcl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c-p2rcl to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9 to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq to ip-10-0-131-226.ec2.internal

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf to ip-10-0-128-31.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-8d6349-6766f4df5b-kw5gt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-8d6349-6766f4df5b-kw5gt to ip-10-0-136-123.ec2.internal

openshift-ingress

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd to ip-10-0-128-31.ec2.internal

openshift-ingress

e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh to ip-10-0-136-123.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5b994dfc85 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

replicaset-controller

router-default-5b994dfc85

SuccessfulCreate

Created pod: router-default-5b994dfc85-2v9ww

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-5b994dfc85-2v9ww

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-5b994dfc85-2v9ww

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-5b994dfc85-2v9ww

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-5b994dfc85-2v9ww

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5b994dfc85-2v9ww

Started

Container started

openshift-ingress

kubelet

router-default-5b994dfc85-2v9ww

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-5b994dfc85-2v9ww

Created

Container created

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-js6cr

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-js6cr

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-js6cr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-js6cr

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-js6cr

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-js6cr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 15.828s (15.828s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-js6cr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-js6cr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-l5d6g

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-856b6dffcf-lmck7

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-856b6dffcf

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-856b6dffcf-lmck7

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-lmck7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-856b6dffcf from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-lmck7

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-lmck7

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-lmck7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.653s (6.653s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.713s (8.713s including waiting). Image size: 183555333 bytes.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-7f5db49b8c from 0 to 3

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7f5db49b8c

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7f5db49b8c

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7f5db49b8c-kr798

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-kr798

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7f5db49b8c

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7f5db49b8c-kr798

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

install-hfmsz

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.739s (2.739s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-kr798

Started

Container started
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.753s (2.753s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-kr798

Created

Container created

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-kr798

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.722s (2.722s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

Started

Container started

opendatahub-operator-system

opendatahub-operator-controller-manager-7f5db49b8c-kr798_3daba63c-ff19-45e0-b726-e0965a17e811

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-7f5db49b8c-kr798_3daba63c-ff19-45e0-b726-e0965a17e811 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 498ms (499ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-kr798

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-kr798

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-xzzq4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-kr798

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 338ms (338ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-kr798

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 439ms (439ms including waiting). Image size: 273709574 bytes.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7f5db49b8c-mxrj6

Created

Container created

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-59qn9

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-59qn9

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-59qn9

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-cfmlr
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-cfmlr

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cfmlr

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-thdmg

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-thdmg

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-m45vq

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-m45vq

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-thdmg

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-m45vq

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-59qn9

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 12.96s (12.96s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-59qn9

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-59qn9

Created

Container created

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-thdmg

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-59qn9_f873bf97-69de-4b8f-acaa-7c05f5bf8e45 became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-thdmg

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-thdmg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.651s (2.651s including waiting). Image size: 177967631 bytes.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-thdmg_ebf190d9-2666-4790-aede-3c49df16e9b2

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-thdmg_ebf190d9-2666-4790-aede-3c49df16e9b2 became leader

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cfmlr

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cfmlr

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cfmlr

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.1s (4.1s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-m45vq

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.071s (3.071s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-m45vq

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-m45vq

Created

Container created

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1
(x9)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-twlhp

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

kubelet

cert-manager-597b95cb84-twlhp

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-597b95cb84-twlhp

Started

Container started

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-hbpn7

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-hbpn7

cert-manager

kubelet

cert-manager-597b95cb84-twlhp

Created

Container created

cert-manager

multus

cert-manager-597b95cb84-twlhp

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-hbpn7

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-9s8vq

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-9s8vq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

authorino-operator-7b7bb4bc77-9s8vq

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-hbpn7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.41s (4.41s including waiting). Image size: 424244516 bytes.

openshift-ingress

replicaset-controller

kube-auth-proxy-5c4bb65c68

SuccessfulCreate

Created pod: kube-auth-proxy-5c4bb65c68-jwxlp

kuadrant-system

authorino-operator-7b7bb4bc77-9s8vq_7635d216-7870-4c1c-93f5-0843acfa88a0

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-9s8vq_7635d216-7870-4c1c-93f5-0843acfa88a0 became leader

openshift-ingress

replicaset-controller

kube-auth-proxy-5c4bb65c68

SuccessfulCreate

Created pod: kube-auth-proxy-5c4bb65c68-z6847

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5c4bb65c68 from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-9s8vq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.324s (1.324s including waiting). Image size: 167738465 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-hbpn7_52f1e005-88d7-4099-a858-9ecab538ba81

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-hbpn7_52f1e005-88d7-4099-a858-9ecab538ba81 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-9s8vq

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-9s8vq

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5c4bb65c68-jwxlp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-59cf4dc6bf

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-59cf4dc6bfrtd7t

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-59cf4dc6bfrtd7t

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5c4bb65c68-jwxlp

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5c4bb65c68-z6847

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-59cf4dc6bfrtd7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

kube-auth-proxy-5c4bb65c68-z6847

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-59cf4dc6bfrtd7t

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-59cf4dc6bfrtd7t

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-59cf4dc6bf from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-g5mql

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-g5mql

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-g5mql

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-5c4bb65c68-jwxlp

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5c4bb65c68-jwxlp

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5c4bb65c68-jwxlp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.392s (2.392s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5c4bb65c68-z6847

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-g5mql

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-g5mql

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.713s (1.713s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-g5mql

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5c4bb65c68-z6847

Started

Container started

kuadrant-system

dns-operator-controller-manager-8557cbdb84-g5mql_db3b0cb9-cdc8-4e87-98cd-33ac6c671946

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-g5mql_db3b0cb9-cdc8-4e87-98cd-33ac6c671946 became leader

openshift-ingress

kubelet

kube-auth-proxy-5c4bb65c68-z6847

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.451s (2.451s including waiting). Image size: 188904677 bytes.

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-jl6p5

kuadrant-system

multus

limitador-limitador-74dfcfb894-jl6p5

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-hmcmc

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-66g66

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-hmcmc

kuadrant-system

multus

authorino-57f7f8659f-hmcmc

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jl6p5

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-7c9b87d574-66g66

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-bqddx

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-66g66

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 922ms (922ms including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-66g66

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-mwq2b

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

multus

authorino-56c6c9ddd5-bqddx

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jl6p5

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jl6p5

Started

Container started

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-mwq2b

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-mwq2b

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-66g66

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-bqddx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-57f7f8659f-hmcmc

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-hmcmc

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-hmcmc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.624s (1.624s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-66g66

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jl6p5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.133s (2.133s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-bqddx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.527s (1.527s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-bqddx

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-bqddx

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-hmcmc

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-mwq2b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.482s (1.482s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-mwq2b

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-mwq2b

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-hmcmc

Killing

Stopping container authorino

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-4tlb7"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-7pzmh"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-576fcc8bf6

SuccessfulCreate

Created pod: jobset-controller-manager-576fcc8bf6-kq8bh

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-576fcc8bf6 from 0 to 1

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-576fcc8bf6-kq8bh

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-576fcc8bf6-kq8bh

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jl6p5

Killing

Stopping container limitador

openshift-jobset-operator

jobset-controller-manager-576fcc8bf6-kq8bh_195a497e-844f-4323-a4bd-a3c796f5ae54

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-576fcc8bf6-kq8bh_195a497e-844f-4323-a4bd-a3c796f5ae54 became leader

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

openshift-jobset-operator

kubelet

jobset-controller-manager-576fcc8bf6-kq8bh

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-576fcc8bf6-kq8bh

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-576fcc8bf6-kq8bh

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.709s (2.709s including waiting). Image size: 182184678 bytes.

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-jl6p5

opendatahub

kserve-module-controller-manager-7566cf5fc8-mwq2b_58be9212-27f0-4f86-9596-b621f2d37cb5

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-mwq2b_58be9212-27f0-4f86-9596-b621f2d37cb5 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

maas-controller-786557dc8d-52sb6

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5749bffc96 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-786557dc8d from 0 to 1

opendatahub

replicaset-controller

maas-controller-5749bffc96

SuccessfulCreate

Created pod: maas-controller-5749bffc96-tr2hn

opendatahub

multus

maas-controller-786557dc8d-52sb6

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-786557dc8d

SuccessfulCreate

Created pod: maas-controller-786557dc8d-52sb6

opendatahub

multus

maas-controller-5749bffc96-tr2hn

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-786557dc8d-52sb6

Created

Container created

opendatahub

kubelet

maas-controller-786557dc8d-52sb6

Started

Container started

opendatahub

kubelet

maas-controller-5749bffc96-tr2hn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 2.283s (2.284s including waiting). Image size: 200069630 bytes.

opendatahub

kubelet

maas-controller-786557dc8d-52sb6

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 2.433s (2.433s including waiting). Image size: 200069630 bytes.

opendatahub

maas-controller-786557dc8d-52sb6_958af143-b876-4ffe-9e2d-f1575c0a74f5

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-786557dc8d-52sb6_958af143-b876-4ffe-9e2d-f1575c0a74f5 became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-wmwrb

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wmwrb

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-wmwrb

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wmwrb

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-786557dc8d from 1 to 0

opendatahub

replicaset-controller

maas-controller-786557dc8d

SuccessfulDelete

Deleted pod: maas-controller-786557dc8d-52sb6

opendatahub

kubelet

maas-controller-786557dc8d-52sb6

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wmwrb

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.993s (10.993s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wmwrb

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wmwrb

Started

Container started

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-scslz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-2lbgw

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-dd578

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-scslz

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-scslz

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-wm62c

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2lbgw

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-kjczm

opendatahub

kubelet

model-serving-api-75bd89fdfc-wm62c

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

model-serving-api-75bd89fdfc-wm62c

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

kubelet

kserve-controller-manager-776cc66d47-dd578

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-2lbgw

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-dd578

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-kjczm

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-kjczm

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-scslz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.747s (2.747s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-scslz

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-scslz

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2lbgw

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-wm62c

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-dd578

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2lbgw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.928s (2.928s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2lbgw

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-scslz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-scslz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

model-serving-api-75bd89fdfc-wm62c

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-wm62c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.598s (2.598s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-dd578

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-dd578

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.095s (3.095s including waiting). Image size: 247676581 bytes.

opendatahub

kserve-controller-manager-776cc66d47-dd578_fce4de65-2e2f-4d20-a93f-44e6b20ceade

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-dd578_fce4de65-2e2f-4d20-a93f-44e6b20ceade became leader

opendatahub

kubelet

odh-model-controller-769875db56-kjczm

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-kjczm

Created

Container created

opendatahub

odh-model-controller-769875db56-kjczm_9b98239f-7037-4339-a125-1160b3811c48

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-kjczm_9b98239f-7037-4339-a125-1160b3811c48 became leader

opendatahub

kubelet

odh-model-controller-769875db56-kjczm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.609s (3.609s including waiting). Image size: 236755567 bytes.

opendatahub

llmisvc-controller-manager-869d5dcc5d-2lbgw_a166a864-6e9b-486b-aae9-dfa7070097fc

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-2lbgw_a166a864-6e9b-486b-aae9-dfa7070097fc became leader

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-js6cr

Killing

Stopping container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-js6cr

Unhealthy

Readiness probe failed: Get "http://10.133.0.20:8080/ready": dial tcp 10.133.0.20:8080: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-js6cr

ProbeError

Readiness probe error: Get "http://10.133.0.20:8080/ready": dial tcp 10.133.0.20:8080: connect: connection refused body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-js6cr

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

maas-controller-5749bffc96-tr2hn_4b52af1e-8f00-4da2-80b1-aa6efafd3d13

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5749bffc96-tr2hn_4b52af1e-8f00-4da2-80b1-aa6efafd3d13 became leader
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-5ls5l

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

Started

Container started

kuadrant-system

replicaset-controller

authorino-674cd869b7

SuccessfulCreate

Created pod: authorino-674cd869b7-wvxv5

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

Created

Container created

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-rmd8t

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-674cd869b7 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-rmd8t

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-5ls5l

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

multus

authorino-674cd869b7-wvxv5

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-674cd869b7-wvxv5

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-674cd869b7-wvxv5

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-674cd869b7-wvxv5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.007s (1.007s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-674cd869b7-wvxv5

Created

Container created

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-bqddx

kuadrant-system

kubelet

authorino-56c6c9ddd5-bqddx

Killing

Stopping container authorino

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-5xns7

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-5xns7

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

multus

llmisvc-controller-manager-6466c554d8-5xns7

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-5xns7

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-5xns7

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-5xns7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 329ms (329ms including waiting). Image size: 235100981 bytes.

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-2lbgw

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2lbgw

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-9z8hf

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "ai-gateway-controller-metrics-tls" not found

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-9z8hf

opendatahub

multus

ai-gateway-controller-7d85675f98-9z8hf

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-9z8hf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-9z8hf

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-9z8hf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.584s (1.584s including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-9z8hf

Created

Container created

opendatahub

ai-gateway-controller-7d85675f98-9z8hf_653f5dd0-d98f-4ad4-a331-66cb311bec77

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-9z8hf_653f5dd0-d98f-4ad4-a331-66cb311bec77 became leader

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-hpphs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-f26kj
(x6)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-f26kj

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-hpphs

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-5f78687d5b-hpphs

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-f26kj

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-f26kj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-f26kj

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-hpphs

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-hpphs

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-hpphs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.146s (2.146s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-f26kj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.199s (2.199s including waiting). Image size: 125317101 bytes.

opendatahub

replicaset-controller

ai-gateway-controller-6577b95894

SuccessfulCreate

Created pod: ai-gateway-controller-6577b95894-swx2g

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6577b95894 from 0 to 1

opendatahub

multus

ai-gateway-controller-6577b95894-swx2g

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-6577b95894-swx2g

Created

Container created

opendatahub

llmisvc-controller-manager-6466c554d8-5xns7_e39d20eb-6daa-439b-ad83-f63b5fc189f0

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-5xns7_e39d20eb-6daa-439b-ad83-f63b5fc189f0 became leader

opendatahub

kubelet

ai-gateway-controller-6577b95894-swx2g

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6577b95894-swx2g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 311ms (311ms including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-6577b95894-swx2g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-9z8hf

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-9z8hf

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

maas-controller-5749bffc96-tr2hn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 356ms (356ms including waiting). Image size: 200069630 bytes.
(x2)

opendatahub

kubelet

maas-controller-5749bffc96-tr2hn

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-5749bffc96-tr2hn

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-5749bffc96-tr2hn

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-f6hfd

opendatahub

maas-controller-5749bffc96-tr2hn_86a836e0-e638-4156-b0a8-90284c9beeda

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5749bffc96-tr2hn_86a836e0-e638-4156-b0a8-90284c9beeda became leader

opendatahub

ai-gateway-controller-6577b95894-swx2g_84f2d654-798a-4984-aa5f-96efed503c75

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6577b95894-swx2g_84f2d654-798a-4984-aa5f-96efed503c75 became leader

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-f6hfd

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-f6hfd

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-f6hfd

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-f6hfd

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-f6hfd

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.193s (1.193s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q92kk

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 214ms (214ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-q92kk

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q92kk

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-q92kk

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q92kk

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q92kk

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-ds65s

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-ds65s

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-ds65s

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-ds65s

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-ds65s

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-ds65s

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 219ms (219ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-l7s2w

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-l7s2w

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-l7s2w

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-l7s2w

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-l7s2w

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 168ms (168ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-l7s2w

Created

Container created

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hfhgh

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hfhgh

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hfhgh

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hfhgh

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hfhgh

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 190ms (190ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hfhgh

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-5vzlj

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

kubelet

echo-simulator-kserve-64b6f8f96c-5vzlj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-5vzlj

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-q47h9

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

kubelet

echo-simulator-kserve-64b6f8f96c-5vzlj

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-hmvkl

llm

kubelet

echo-simulator-kserve-64b6f8f96c-5vzlj

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 1 to 4

llm

kubelet

echo-simulator-kserve-64b6f8f96c-5vzlj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.514s (1.514s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-5mhqr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-6g2sk

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-hmvkl

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-hmvkl

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q47h9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-q47h9

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-hmvkl

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

Created

Container created

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-hmvkl

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 190ms (190ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-hmvkl

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.799s (1.799s including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q47h9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.761s (2.761s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q47h9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.698s (2.698s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q47h9

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q47h9

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q47h9

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q47h9

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q47h9

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-9jxv8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-mlqh8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-2q89w

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-nnt77

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2q89w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mlqh8

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-mlqh8

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mlqh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mlqh8

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-2q89w

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2q89w

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-nnt77

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2q89w

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

replicaset-controller

authorino-b4cbf4fd4

SuccessfulCreate

Created pod: authorino-b4cbf4fd4-7wnrx
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

kuadrant-system

kubelet

authorino-b4cbf4fd4-7wnrx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-b4cbf4fd4-7wnrx

Started

Container started

kuadrant-system

kubelet

authorino-b4cbf4fd4-7wnrx

Created

Container created

kuadrant-system

kubelet

authorino-b4cbf4fd4-7wnrx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 645ms (645ms including waiting). Image size: 204096810 bytes.

kuadrant-system

multus

authorino-b4cbf4fd4-7wnrx

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2q89w

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mlqh8

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mlqh8

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2q89w

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused

kuadrant-system

kubelet

authorino-674cd869b7-wvxv5

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-674cd869b7

SuccessfulDelete

Deleted pod: authorino-674cd869b7-wvxv5
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-674cd869b7 from 1 to 0

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-54g5w

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-54g5w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-54g5w

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-54g5w

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-28h4s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-54g5w

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-28h4s

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-28h4s

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-28h4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-28h4s

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-28h4s

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-54g5w

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-54g5w

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-9c94fbc2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9c94fbc2

openshift-ingress

deployment-controller

e2e-ait-c45a2ff8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c45a2ff8-openshift-default-646b99d9d7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-c45a2ff8-openshift-default-646b99d9d7

SuccessfulCreate

Created pod: e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz

openshift-ingress

gateway_labeler_controller

e2e-ait-c45a2ff8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c45a2ff8

openshift-ingress

replicaset-controller

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f

SuccessfulCreate

Created pod: e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

openshift-ingress

multus

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-798193ae-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-798193ae-gw

openshift-ingress

replicaset-controller

e2e-ait-9c94fbc2-openshift-default-64f47b77d9

SuccessfulCreate

Created pod: e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

openshift-ingress

deployment-controller

e2e-ait-9c94fbc2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9c94fbc2-openshift-default-64f47b77d9 from 0 to 1

openshift-ingress

deployment-controller

e2e-migrate-798193ae-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-798193ae-gw-openshift-default-58c6597d6f from 0 to 1

openshift-ingress

multus

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-55140dc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-55140dc4

openshift-ingress

deployment-controller

e2e-ait-55140dc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-55140dc4-openshift-default-cd74ccd77 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-55140dc4-openshift-default-cd74ccd77

SuccessfulCreate

Created pod: e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

openshift-ingress

multus

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-798193ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-798193ae-787bd8875 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-798193ae-66b87c8994

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-798193ae-66b87c8994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-798193ae: serviceaccount "payload-processing-e2e-migrate-798193ae" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-798193ae-787bd8875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-798193ae-787bd8875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-798193ae: serviceaccount "payload-processing-e2e-migrate-798193ae" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-798193ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-798193ae-66b87c8994 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-798193ae-66b87c8994

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-798193ae-66b87c8994-w7jsx

openshift-ingress

multus

payload-processing-e2e-migrate-798193ae-66b87c8994-w7jsx

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-798193ae-66b87c8994-w7jsx

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-798193ae-787bd8875-pml7v

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-migrate-798193ae-787bd8875-pml7v

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-798193ae-787bd8875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-798193ae-787bd8875-pml7v
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c45a2ff8: serviceaccount "payload-processing-e2e-ait-c45a2ff8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-jsnh9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c45a2ff8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c45a2ff8-875d9b65b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c45a2ff8-875d9b65b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c45a2ff8: serviceaccount "payload-processing-e2e-ait-c45a2ff8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c45a2ff8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c45a2ff8-875d9b65b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9c94fbc2-9c7c645f4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9c94fbc2-9c7c645f4-dnpds

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9c94fbc2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-jsnh9

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-jsnh9

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c-nnkrt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9c94fbc2: serviceaccount "payload-processing-e2e-ait-9c94fbc2" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9c94fbc2-9c7c645f4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9c94fbc2-9c7c645f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9c94fbc2: serviceaccount "payload-processing-e2e-ait-9c94fbc2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9c94fbc2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9c94fbc2-9c7c645f4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-c45a2ff8-875d9b65b-k9mff

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c45a2ff8-875d9b65b-k9mff

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c45a2ff8-875d9b65b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c45a2ff8-875d9b65b-k9mff

openshift-ingress

kubelet

payload-processing-e2e-migrate-798193ae-66b87c8994-w7jsx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-798193ae-66b87c8994-w7jsx

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-55140dc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-c45a2ff8-875d9b65b-k9mff

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c-nnkrt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-55140dc4: serviceaccount "payload-processing-e2e-ait-55140dc4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-798193ae-787bd8875-pml7v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-c45a2ff8-875d9b65b-k9mff

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c-nnkrt

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-798193ae-787bd8875-pml7v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c-nnkrt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c-nnkrt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-c45a2ff8-875d9b65b-k9mff

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 495ms (495ms including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-9c94fbc2-9c7c645f4-dnpds

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-9c94fbc2-9c7c645f4-dnpds

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-9c94fbc2-9c7c645f4-dnpds

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-55140dc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-55140dc4-8b8949786 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-798193ae-787bd8875-pml7v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.512s (2.512s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-jsnh9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 724ms (724ms including waiting). Image size: 125317101 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf-jq79g

openshift-ingress

kubelet

payload-processing-e2e-migrate-798193ae-66b87c8994-w7jsx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.191s (2.191s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-9c94fbc2-9c7c645f4-dnpds

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-jsnh9

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-55140dc4-8b8949786

FailedCreate

Error creating: pods "payload-processing-e2e-ait-55140dc4-8b8949786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-55140dc4: serviceaccount "payload-processing-e2e-ait-55140dc4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-jsnh9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf-jq79g

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-55140dc4-8b8949786-lshn2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-55140dc4-8b8949786-lshn2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-55140dc4-8b8949786-lshn2

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-55140dc4-8b8949786

SuccessfulCreate

Created pod: payload-processing-e2e-ait-55140dc4-8b8949786-lshn2

openshift-ingress

kubelet

payload-processing-e2e-ait-55140dc4-8b8949786-lshn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf-jq79g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf-jq79g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf-jq79g

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-derive-3627d700

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3627d700

openshift-ingress

deployment-controller

e2e-derive-3627d700-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3627d700-openshift-default-7fc86ddc7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-3627d700-openshift-default-7fc86ddc7

SuccessfulCreate

Created pod: e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

openshift-ingress

multus

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3627d700-74849467dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3627d700-74849467dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3627d700: serviceaccount "payload-processing-e2e-derive-3627d700" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3627d700-74849467dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3627d700-74849467dc-497gz

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3627d700

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3627d700-796cffd94 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9c94fbc2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3627d700

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3627d700-74849467dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3627d700-796cffd94

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3627d700-796cffd94-gbs8r
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3627d700-796cffd94

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3627d700-796cffd94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3627d700: serviceaccount "payload-processing-e2e-derive-3627d700" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9c94fbc2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3627d700-74849467dc-497gz

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-55140dc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-derive-3627d700-796cffd94-gbs8r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3627d700-74849467dc-497gz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3627d700-74849467dc-497gz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-3627d700-74849467dc-497gz

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-3627d700-796cffd94-gbs8r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-3627d700-796cffd94-gbs8r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-derive-3627d700-796cffd94-gbs8r

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-55140dc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:53060->10.132.0.54:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:53060->10.132.0.54:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-798193ae-66b87c8994-w7jsx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-798193ae-787bd8875-pml7v

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c45a2ff8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c45a2ff8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9c94fbc2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-798193ae-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-798193ae-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9c94fbc2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-55140dc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-55140dc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c45a2ff8-5dd6fc9fc9-jsnh9

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-c45a2ff8-875d9b65b-k9mff

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9c94fbc2-7d8d55f76c-nnkrt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9c94fbc2-9c7c645f4-dnpds

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-c45a2ff8-openshift-default-646b99d9d7-sf9xz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-798193ae-gw-openshift-default-58c6597d6f-l254v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-55140dc4-7cc7c6cbcf-jq79g

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-aaf467

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-aaf467

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-8d6349

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-8d6349

openshift-ingress

kubelet

payload-processing-e2e-ait-55140dc4-8b8949786-lshn2

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 0 to 1

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-eaee88

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-eaee88

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

openshift-ingress

kubelet

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-9c94fbc2-openshift-default-64f47b77d9-cc5bf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-8d6349

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-8d6349-796776cf47 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-8d6349-796776cf47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-8d6349: serviceaccount "payload-processing-e2e-worker-w3-8d6349" not found

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-8d6349

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-8d6349-6766f4df5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-a519e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-a519e9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-8d6349-796776cf47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-c7m7g

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-8d6349-6766f4df5b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-8d6349-6766f4df5b-kw5gt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-8d6349-6766f4df5b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-8d6349-6766f4df5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-8d6349: serviceaccount "payload-processing-e2e-worker-w3-8d6349" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8d6349-6766f4df5b-kw5gt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8d6349-6766f4df5b-kw5gt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8d6349-6766f4df5b-kw5gt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-8d6349-6766f4df5b-kw5gt

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-c7m7g

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-c7m7g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-c7m7g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-c7m7g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-v6pxh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-aaf467

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-aaf467-544d8fdc84-jjcv9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-v6pxh

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-aaf467-544d8fdc84

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-aaf467-544d8fdc84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-aaf467: serviceaccount "payload-processing-e2e-worker-w2-aaf467" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-aaf467-544d8fdc84

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-aaf467-544d8fdc84-jjcv9

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-aaf467

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-aaf467-544d8fdc84 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-aaf467: serviceaccount "payload-processing-e2e-worker-w2-aaf467" not found

openshift-ingress

multus

payload-processing-e2e-worker-w2-aaf467-544d8fdc84-jjcv9

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc-zq8v9

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-eaee88-544ddb87d6

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-eaee88-544ddb87d6-cckhd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-eaee88: serviceaccount "payload-processing-e2e-worker-w4-eaee88" not found

openshift-ingress

kubelet

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-aaf467-544d8fdc84-jjcv9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w4-eaee88-544ddb87d6-cckhd

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-eaee88

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-eaee88-544ddb87d6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-aaf467-544d8fdc84-jjcv9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-v6pxh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-v6pxh

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc-zq8v9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-eaee88

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-v6pxh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc-zq8v9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-55140dc4-openshift-default-cd74ccd77-2tvbj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-eaee88-544ddb87d6

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-eaee88-544ddb87d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-eaee88: serviceaccount "payload-processing-e2e-worker-w4-eaee88" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-eaee88-544ddb87d6-cckhd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc-zq8v9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc-zq8v9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-eaee88-544ddb87d6-cckhd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-eaee88-544ddb87d6-cckhd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3627d700-74849467dc-497gz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3627d700-796cffd94-gbs8r

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-a519e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-a519e9-7b75656447 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a519e9-7b75656447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-a519e9-7b75656447-pgbsg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a519e9-7b75656447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-a519e9-7b75656447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a519e9: serviceaccount "payload-processing-e2e-worker-w0-a519e9" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a519e9-8c464697d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-a519e9-8c464697d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a519e9: serviceaccount "payload-processing-e2e-worker-w0-a519e9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-a519e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-a519e9-8c464697d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a519e9-8c464697d-gpjt7

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a519e9-8c464697d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-a519e9-8c464697d-gpjt7

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-a519e9-7b75656447-pgbsg

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a519e9-7b75656447-pgbsg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a519e9-7b75656447-pgbsg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a519e9-7b75656447-pgbsg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a519e9-8c464697d-gpjt7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-a519e9-8c464697d-gpjt7

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a519e9-8c464697d-gpjt7

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-3627d700-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-3627d700-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-8d44dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-8d44dd

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulCreate

Created pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

openshift-ingress

kubelet

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-3627d700-openshift-default-7fc86ddc7-vqz6r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-8d44dd-5994685567

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-8d44dd: serviceaccount "payload-processing-e2e-worker-w1-8d44dd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-8d44dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-8d44dd-5994685567 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-8d44dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-8d44dd-f699bfc76 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-8d44dd-f699bfc76

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-8d44dd-f699bfc76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-8d44dd: serviceaccount "payload-processing-e2e-worker-w1-8d44dd" not found
(x2)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-8d44dd-5994685567

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-pfkgg

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-8d44dd-f699bfc76

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-8d44dd-f699bfc76-46t7w

openshift-ingress

multus

payload-processing-e2e-worker-w1-8d44dd-f699bfc76-46t7w

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-8d44dd-f699bfc76-46t7w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-pfkgg

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-pfkgg

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-8d44dd-f699bfc76-46t7w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-pfkgg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-pfkgg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-8d44dd-f699bfc76-46t7w

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

Created

Container created

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulCreate

Created pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 2 to 3
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-28h4s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-l5d6g

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-28h4s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-l5d6g

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 3 to 5

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

Started

Container started

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

Created

Container created

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulCreate

Created pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 5 to 8

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

Created

Container created

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

Started

Container started

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 1 to 3

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

Created

Container created

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

ProbeError

Readiness probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

Unhealthy

Readiness probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-ba44b248

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ba44b248

openshift-ingress

deployment-controller

e2e-mt-ba44b248-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ba44b248-openshift-default-8597d4c685 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-ba44b248-openshift-default-8597d4c685

SuccessfulCreate

Created pod: e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

openshift-ingress

multus

e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

Created

Container created

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulCreate

Created pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

Started

Container started

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

Started

Container started

openshift-ingress

multus

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ba44b248-d59758b87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ba44b248-d59758b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ba44b248: serviceaccount "payload-processing-e2e-mt-ba44b248" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ba44b248-868467698b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ba44b248-868467698b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ba44b248: serviceaccount "payload-processing-e2e-mt-ba44b248" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ba44b248-d59758b87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ba44b248-d59758b87-pj7z9

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ba44b248

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ba44b248-868467698b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ba44b248-868467698b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ba44b248-868467698b-kfvjh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ba44b248

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ba44b248-d59758b87 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-ba44b248-868467698b-kfvjh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-ba44b248-868467698b-kfvjh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-ba44b248-868467698b-kfvjh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-ba44b248-868467698b-kfvjh

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-ba44b248-d59758b87-pj7z9

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ba44b248-d59758b87-pj7z9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ba44b248-d59758b87-pj7z9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ba44b248-d59758b87-pj7z9

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

Created

Container created

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-58847f9fc5-rrwcn
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 8 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

Created

Container created

openshift-ingress

deployment-controller

e2e-api-a-1ec766-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1ec766-openshift-default-69f8887585 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-1ec766-openshift-default-69f8887585

SuccessfulCreate

Created pod: e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

openshift-ingress

gateway_labeler_controller

e2e-api-a-1ec766

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1ec766

openshift-ingress

multus

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1ec766

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1ec766-745546f55f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1ec766-745546f55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1ec766-745546f55f-9t8z9

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1ec766-77bd9f9458

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1ec766-77bd9f9458-ls5rl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1ec766-745546f55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1ec766-745546f55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1ec766: serviceaccount "payload-processing-e2e-api-a-1ec766" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1ec766

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1ec766-77bd9f9458 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1ec766-77bd9f9458

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1ec766-77bd9f9458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1ec766: serviceaccount "payload-processing-e2e-api-a-1ec766" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-1ec766-77bd9f9458-ls5rl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1ec766-745546f55f-9t8z9

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-1ec766-77bd9f9458-ls5rl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-1ec766-77bd9f9458-ls5rl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1ec766-745546f55f-9t8z9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ba44b248-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ba44b248-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-api-a-1ec766-77bd9f9458-ls5rl

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1ec766-745546f55f-9t8z9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1ec766-745546f55f-9t8z9

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

Created

Container created

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

Started

Container started

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

Started

Container started

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk

Created

Container created

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

Unhealthy

Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

ProbeError

Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 8 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

gateway_labeler_controller

e2e-api-b-f789d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f789d7

openshift-ingress

replicaset-controller

e2e-api-b-f789d7-openshift-default-6f89948549

SuccessfulCreate

Created pod: e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

openshift-ingress

deployment-controller

e2e-api-b-f789d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f789d7-openshift-default-6f89948549 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-f5g5p

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-f5g5p

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f5g5p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f5g5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f5g5p

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f5g5p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f5g5p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 6 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f789d7-84df74b86b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f789d7-84df74b86b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f789d7: serviceaccount "payload-processing-e2e-api-b-f789d7" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f789d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f789d7-84df74b86b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f789d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f789d7-7795658f8c from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f789d7-84df74b86b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f789d7-84df74b86b-tqn5j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f789d7-7795658f8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f789d7-7795658f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f789d7: serviceaccount "payload-processing-e2e-api-b-f789d7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f789d7-7795658f8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f789d7-7795658f8c-4h5s8

openshift-ingress

kubelet

payload-processing-e2e-api-b-f789d7-84df74b86b-tqn5j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-f789d7-84df74b86b-tqn5j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-f789d7-84df74b86b-tqn5j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f789d7-7795658f8c-4h5s8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-f789d7-84df74b86b-tqn5j

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f789d7-7795658f8c-4h5s8

Created

Container created

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

Unhealthy

Readiness probe failed: Get "http://10.132.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f789d7-7795658f8c-4h5s8

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f789d7-7795658f8c-4h5s8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

ProbeError

Readiness probe error: Get "http://10.132.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1ec766-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1ec766-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ba44b248-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ba44b248-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-a-e6df62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e6df62

openshift-ingress

deployment-controller

e2e-api-a-e6df62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e6df62-openshift-default-7cc85f6f9f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-e6df62-openshift-default-7cc85f6f9f

SuccessfulCreate

Created pod: e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

openshift-ingress

multus

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulCreate

Created pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

Started

Container started

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

Created

Container created

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1ec766-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1ec766-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e6df62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e6df62-fd6b46799 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e6df62-fd6b46799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e6df62-fd6b46799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e6df62: serviceaccount "payload-processing-e2e-api-a-e6df62" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e6df62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e6df62-cd88fc896 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e6df62-cd88fc896

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e6df62-cd88fc896-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e6df62: serviceaccount "payload-processing-e2e-api-a-e6df62" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e6df62-cd88fc896

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e6df62-cd88fc896-qzpvw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e6df62-fd6b46799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e6df62-fd6b46799-ks5zx

openshift-ingress

kubelet

payload-processing-e2e-api-a-e6df62-cd88fc896-qzpvw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-e6df62-cd88fc896-qzpvw

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-e6df62-cd88fc896-qzpvw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e6df62-fd6b46799-ks5zx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e6df62-fd6b46799-ks5zx

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e6df62-fd6b46799-ks5zx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-e6df62-cd88fc896-qzpvw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e6df62-fd6b46799-ks5zx

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

Unhealthy

Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

ProbeError

Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

Unhealthy

Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

ProbeError

Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1ec766-745546f55f-9t8z9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1ec766-77bd9f9458-ls5rl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7318-884907

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

Started

Container started

opendatahub

kubelet

test-curl-7318-884907

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7318-884907

Started

Container started

opendatahub

kubelet

test-curl-7318-884907

Created

Container created

opendatahub

kubelet

test-curl-7318-884907

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 597ms (597ms including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7318-884907

Killing

Stopping container test-curl-7318-884907
(x5)

openshift-ingress

kubelet

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

ProbeError

Startup probe error: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

Unhealthy

Startup probe failed: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e6df62-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e6df62-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-mt-ba44b248-868467698b-kfvjh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ba44b248-d59758b87-pj7z9

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f789d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f789d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-a-e6df62-openshift-default-7cc85f6f9f

SuccessfulCreate

Created pod: e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d

openshift-ingress

replicaset-controller

e2e-api-a-e6df62-openshift-default-7cc85f6f9f

SuccessfulCreate

Created pod: e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e6df62-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp

Created

Container created

openshift-ingress

deployment-controller

e2e-api-b-fe108e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-fe108e-openshift-default-6487d559b9 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp

Started

Container started

openshift-ingress

multus

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-e6df62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e6df62-openshift-default-7cc85f6f9f from 1 to 3

openshift-ingress

multus

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-fe108e-openshift-default-6487d559b9

SuccessfulCreate

Created pod: e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-b-fe108e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-fe108e

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

Created

Container created

openshift-ingress

multus

e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

ProbeError

Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

Unhealthy

Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-fe108e: serviceaccount "payload-processing-e2e-api-b-fe108e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55-q685s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-fe108e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-fe108e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-fe108e-6d695b9794 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-fe108e-6d695b9794

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-fe108e-6d695b9794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-fe108e: serviceaccount "payload-processing-e2e-api-b-fe108e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-fe108e-6d695b9794

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-fe108e-6d695b9794-ftnff

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55-q685s

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55-q685s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-fe108e-6d695b9794-ftnff

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-fe108e-6d695b9794-ftnff

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-fe108e-6d695b9794-ftnff

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-fe108e-6d695b9794-ftnff

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55-q685s

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55-q685s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-c15d3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c15d3a-openshift-default-695c69b767 from 0 to 1
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-ba44b248-868467698b-kfvjh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-api-a-c15d3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c15d3a

openshift-ingress

replicaset-controller

e2e-api-a-c15d3a-openshift-default-695c69b767

SuccessfulCreate

Created pod: e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn

openshift-ingress

multus

e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ba44b248-d59758b87-pj7z9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f789d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f789d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e6df62-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-e6df62-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c15d3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c15d3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c15d3a-67bdf8c648 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c15d3a-67bdf8c648

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c15d3a-67bdf8c648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c15d3a: serviceaccount "payload-processing-e2e-api-a-c15d3a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7-fprtw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c15d3a: serviceaccount "payload-processing-e2e-api-a-c15d3a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c15d3a-67bdf8c648

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c15d3a-67bdf8c648-smxp7

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7-fprtw

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-c15d3a-67bdf8c648-smxp7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-c15d3a-67bdf8c648-smxp7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c15d3a-67bdf8c648-smxp7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7-fprtw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-c15d3a-67bdf8c648-smxp7

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7-fprtw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7-fprtw

Started

Container started

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-1ec766-openshift-default-69f8887585

FailedCreate

Error creating: pods "e2e-api-a-1ec766-openshift-default-69f8887585-" is forbidden: error looking up service account openshift-ingress/e2e-api-a-1ec766-openshift-default: serviceaccount "e2e-api-a-1ec766-openshift-default" not found

openshift-ingress

deployment-controller

e2e-api-a-1ec766-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1ec766-openshift-default-69f8887585 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-1ec766-openshift-default-69f8887585-55l2h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-f789d7-84df74b86b-tqn5j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f789d7-7795658f8c-4h5s8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2q89w

ProbeError

Readiness probe error: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2q89w

Unhealthy

Readiness probe failed: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ba44b248

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ba44b248-d59758b87 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ba44b248-868467698b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ba44b248-868467698b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ba44b248: serviceaccount "payload-processing-e2e-mt-ba44b248" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ba44b248

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ba44b248-868467698b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ba44b248-d59758b87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ba44b248-d59758b87-4cn26
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ba44b248-d59758b87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ba44b248-d59758b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ba44b248: serviceaccount "payload-processing-e2e-mt-ba44b248" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-ba44b248-d59758b87-4cn26

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ba44b248-868467698b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ba44b248-868467698b-2z4nc

openshift-ingress

kubelet

payload-processing-e2e-mt-ba44b248-868467698b-2z4nc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-ba44b248-868467698b-2z4nc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-ba44b248-868467698b-2z4nc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-ba44b248-868467698b-2z4nc

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ba44b248-d59758b87-4cn26

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ba44b248-d59758b87-4cn26

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ba44b248-d59758b87-4cn26

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e6df62-fd6b46799-ks5zx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e6df62-cd88fc896-qzpvw

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-f7a606

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f7a606

openshift-ingress

deployment-controller

e2e-api-b-f7a606-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f7a606-openshift-default-6887bbc9cf from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-f7a606-openshift-default-6887bbc9cf

SuccessfulCreate

Created pod: e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

openshift-ingress

multus

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f7a606-6f7fd6cf96

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f7a606-6f7fd6cf96-pcpbw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55-4scp6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f7a606

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f7a606-6f7fd6cf96

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f7a606-6f7fd6cf96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f7a606: serviceaccount "payload-processing-e2e-api-b-f7a606" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f7a606

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f7a606-6f7fd6cf96 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f7a606: serviceaccount "payload-processing-e2e-api-b-f7a606" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55-4scp6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55-4scp6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-f7a606-6f7fd6cf96-pcpbw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-f7a606-6f7fd6cf96-pcpbw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55-4scp6

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55-4scp6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-f7a606-6f7fd6cf96-pcpbw

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f7a606-6f7fd6cf96-pcpbw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-f789d7-openshift-default-6f89948549-8zh7n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-fe108e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-fe108e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn

Created

Container created

opendatahub

kubelet

test-curl-7318-22964b

Created

Container created

opendatahub

kubelet

test-curl-7318-22964b

Started

Container started

opendatahub

multus

test-curl-7318-22964b

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7318-22964b

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7318-22964b

Killing

Stopping container test-curl-7318-22964b
(x6)

openshift-ingress

kubelet

e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c15d3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c15d3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-ba44b248-868467698b-2z4nc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ba44b248-d59758b87-4cn26

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-l4jkp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-slc8d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-e6df62-openshift-default-7cc85f6f9f-kx4kl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-fe108e-6d695b9794-ftnff

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fe108e-b4fcd4c55-q685s

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c15d3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c15d3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c15d3a-7fd99699b7-fprtw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c15d3a-67bdf8c648-smxp7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

ProbeError

Readiness probe error: Get "http://10.132.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

Unhealthy

Readiness probe failed: Get "http://10.132.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

ProbeError

Readiness probe error: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

Unhealthy

Readiness probe failed: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

Unhealthy

Startup probe failed: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

ProbeError

Startup probe error: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f7a606-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f7a606-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-fe108e-openshift-default-6487d559b9-6ff5b

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-33c99c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-33c99c
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f7a606-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f7a606-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-a-33c99c-openshift-default-66f697958c

SuccessfulCreate

Created pod: e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

openshift-ingress

kubelet

e2e-api-a-c15d3a-openshift-default-695c69b767-fq8qn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-33c99c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-33c99c-openshift-default-66f697958c from 0 to 1

openshift-ingress

multus

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-584c9d-openshift-default-7756f8d445

SuccessfulCreate

Created pod: e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-584c9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-584c9d

openshift-ingress

deployment-controller

e2e-ipp-a-584c9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-584c9d-openshift-default-7756f8d445 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-ba44b248-openshift-default-8597d4c685-2m4br

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-33c99c: serviceaccount "payload-processing-e2e-ipp-a-33c99c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-33c99c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-33c99c-fbb7dd756 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-33c99c-fbb7dd756

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-33c99c-fbb7dd756-l8bj7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-33c99c-fbb7dd756

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-33c99c-fbb7dd756-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-33c99c: serviceaccount "payload-processing-e2e-ipp-a-33c99c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-33c99c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467-qjtc5

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467-qjtc5

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467-qjtc5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467-qjtc5

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

openshift-ingress

deployment-controller

e2e-api-a-0fab6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-0fab6d-openshift-default-78c469c695 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467-qjtc5

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-33c99c-fbb7dd756-l8bj7

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-33c99c-fbb7dd756-l8bj7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-a-0fab6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-0fab6d

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-584c9d-744b84fc6b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-584c9d-744b84fc6b-82z82

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-584c9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-584c9d-744b84fc6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-584c9d-744b84fc6b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-584c9d-744b84fc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-584c9d: serviceaccount "payload-processing-e2e-ipp-a-584c9d" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-33c99c-fbb7dd756-l8bj7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-33c99c-fbb7dd756-l8bj7

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-584c9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-584c9d-744b84fc6b-82z82

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47-tvx78
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-584c9d: serviceaccount "payload-processing-e2e-ipp-a-584c9d" not found

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47-tvx78

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47-tvx78

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-584c9d-744b84fc6b-82z82

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-584c9d-744b84fc6b-82z82

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-584c9d-744b84fc6b-82z82

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47-tvx78

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47-tvx78

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f7a606-6ff7ccdd55-4scp6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f7a606-6f7fd6cf96-pcpbw

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-0fab6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-0fab6d-798fc6fdb4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0fab6d-798fc6fdb4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-0fab6d-798fc6fdb4-82s44

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-0fab6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499-d8msd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0fab6d: serviceaccount "payload-processing-e2e-api-a-0fab6d" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0fab6d-798fc6fdb4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-0fab6d-798fc6fdb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0fab6d: serviceaccount "payload-processing-e2e-api-a-0fab6d" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499-d8msd

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-0fab6d-798fc6fdb4-82s44

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499-d8msd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499-d8msd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499-d8msd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-0fab6d-798fc6fdb4-82s44

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-0fab6d-798fc6fdb4-82s44

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-0fab6d-798fc6fdb4-82s44

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f50f6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f50f6e

openshift-ingress

replicaset-controller

e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7

SuccessfulCreate

Created pod: e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m

openshift-ingress

deployment-controller

e2e-ipp-a-f50f6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f50f6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f50f6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95-vx5bm

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f50f6e: serviceaccount "payload-processing-e2e-ipp-a-f50f6e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95-vx5bm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95-vx5bm

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95-vx5bm

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84-5t78j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f50f6e: serviceaccount "payload-processing-e2e-ipp-a-f50f6e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95-vx5bm

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84-5t78j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84-5t78j

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84-5t78j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84-5t78j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-33c99c-fbb7dd756-l8bj7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-33c99c-7f645f5467-qjtc5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-584c9d-744b84fc6b-82z82

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-584c9d-67d86d4c47-tvx78

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

Unhealthy

Readiness probe failed: Get "http://10.132.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

ProbeError

Readiness probe error: Get "http://10.132.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

openshift-ingress

gateway_labeler_controller

e2e-api-b-31407e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-31407e

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-thg89

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-nr5zc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-hhqc6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-mjcw7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9hmcs

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 10 to 5

openshift-ingress

replicaset-controller

e2e-api-b-31407e-openshift-default-6bf5cb57c5

SuccessfulCreate

Created pod: e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

openshift-ingress

deployment-controller

e2e-api-b-31407e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-31407e-openshift-default-6bf5cb57c5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9jhqt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

openshift-ingress

multus

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-wqhzz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 10 to 5

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zxv5g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-ck2vz

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-9gdd2

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 9 to 8

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulDelete

Deleted pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hqw9j

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

ProbeError

Readiness probe error: Get "http://10.132.0.156:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 4 to 2

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-33c99c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-33c99c-5f5c495f66 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulDelete

Deleted pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

Unhealthy

Readiness probe failed: Get "http://10.132.0.156:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulDelete

Deleted pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-jtrmn

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-33c99c-5f5c495f66

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-33c99c-5f5c495f66-hmmgf
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-33c99c-5f5c495f66

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-33c99c-5f5c495f66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-33c99c: serviceaccount "payload-processing-e2e-ipp-a-33c99c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-33c99c-74989c67f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-hs88d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-33c99c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-33c99c-74989c67f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-33c99c-74989c67f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-33c99c: serviceaccount "payload-processing-e2e-ipp-a-33c99c" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-hs88d

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-hs88d

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-33c99c-5f5c495f66-hmmgf

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-33c99c-5f5c495f66-hmmgf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

e2e-api-b-f7a606-openshift-default-6887bbc9cf-wc2s2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-hs88d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-33c99c-5f5c495f66-hmmgf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.027s (2.027s including waiting). Image size: 166612641 bytes.
(x2)

openshift-ingress

kubelet

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-33c99c-5f5c495f66-hmmgf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-33c99c-5f5c495f66-hmmgf

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-31407e-78c4f67fb8

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-31407e-78c4f67fb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-31407e: serviceaccount "payload-processing-e2e-api-b-31407e" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-31407e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-31407e-78c4f67fb8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-hs88d

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-31407e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-31407e-5969d8795 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-31407e-5969d8795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-31407e-5969d8795-tl5rd

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-hs88d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.149s (2.149s including waiting). Image size: 166612641 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-33c99c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-31407e-5969d8795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-31407e-5969d8795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-31407e: serviceaccount "payload-processing-e2e-api-b-31407e" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-33c99c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c

SuccessfulCreate

Created pod: e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km

openshift-ingress

multus

payload-pre-processing-e2e-api-b-31407e-5969d8795-tl5rd

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-532f3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-532f3b

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-584c9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-584c9d-5947df7d8 from 0 to 1

openshift-ingress

deployment-controller

e2e-ipp-a-532f3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-31407e-5969d8795-tl5rd

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-31407e-78c4f67fb8

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-31407e-78c4f67fb8-nkhjz

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-31407e-5969d8795-tl5rd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-31407e-5969d8795-tl5rd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-584c9d-5947df7d8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-584c9d-5947df7d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-584c9d: serviceaccount "payload-processing-e2e-ipp-a-584c9d" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-584c9d: serviceaccount "payload-processing-e2e-ipp-a-584c9d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-584c9d-5947df7d8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-584c9d-5947df7d8-g6p5b

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-584c9d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-584c9d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67-qhcgf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-584c9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67-qhcgf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-584c9d-5947df7d8-g6p5b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-584c9d-5947df7d8-g6p5b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-584c9d-5947df7d8-g6p5b

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-31407e-78c4f67fb8-nkhjz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-31407e-78c4f67fb8-nkhjz

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67-qhcgf

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67-qhcgf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67-qhcgf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-31407e-78c4f67fb8-nkhjz

Created

Container created

openshift-ingress

multus

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-31407e-78c4f67fb8-nkhjz

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-584c9d-5947df7d8-g6p5b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cf8t2

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

ProbeError

Startup probe error: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

Unhealthy

Startup probe failed: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0fab6d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-api-a-0fab6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-0fab6d-openshift-default-78c469c695 from 1 to 4

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr
(x7)

openshift-ingress

kubelet

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

Started

Container started

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

Started

Container started

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-532f3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb from 0 to 1

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

Created

Container created

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

Started

Container started

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

Created

Container created

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-532f3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-532f3b: serviceaccount "payload-processing-e2e-ipp-a-532f3b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb-ddn7f

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c-zql6j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-532f3b: serviceaccount "payload-processing-e2e-ipp-a-532f3b" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c-zql6j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb-ddn7f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb-ddn7f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb-ddn7f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulDelete

Deleted pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

openshift-ingress

multus

payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb-ddn7f

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c-zql6j

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulDelete

Deleted pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 8 to 5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c-zql6j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c-zql6j

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulDelete

Deleted pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-v7xfz

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-742qp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-s7r9f

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

ProbeError

Startup probe error: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

Unhealthy

Startup probe failed: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f50f6e-7f47794f95-vx5bm

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a55a4b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a55a4b

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f50f6e-9d9bd6c84-5t78j

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9

SuccessfulCreate

Created pod: e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

openshift-ingress

deployment-controller

e2e-ipp-b-a55a4b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8272af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8272af

openshift-ingress

deployment-controller

e2e-ipp-b-8272af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8272af-openshift-default-955c6877 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-8272af-openshift-default-955c6877

SuccessfulCreate

Created pod: e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

openshift-ingress

multus

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0fab6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0fab6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a55a4b-665d74b76b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a55a4b-665d74b76b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a55a4b: serviceaccount "payload-processing-e2e-ipp-b-a55a4b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a55a4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a55a4b-665d74b76b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979-tw8gm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a55a4b: serviceaccount "payload-processing-e2e-ipp-b-a55a4b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a55a4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a55a4b-665d74b76b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a55a4b-665d74b76b-6rnkx

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a55a4b-665d74b76b-6rnkx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a55a4b-665d74b76b-6rnkx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979-tw8gm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979-tw8gm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979-tw8gm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979-tw8gm

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a55a4b-665d74b76b-6rnkx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-a55a4b-665d74b76b-6rnkx

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8272af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7-9lnl6

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8272af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8272af-64c9997f4b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8272af-64c9997f4b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8272af-64c9997f4b-8kzwk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8272af: serviceaccount "payload-processing-e2e-ipp-b-8272af" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8272af-64c9997f4b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8272af-64c9997f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8272af: serviceaccount "payload-processing-e2e-ipp-b-8272af" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8272af-64c9997f4b-8kzwk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7-9lnl6

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f50f6e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8272af-64c9997f4b-8kzwk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7-9lnl6

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-8272af-64c9997f4b-8kzwk

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8272af-64c9997f4b-8kzwk

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f50f6e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7-9lnl6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7-9lnl6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-33c99c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-33c99c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-584c9d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-584c9d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f50f6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f50f6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f50f6e-64658675d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f50f6e: serviceaccount "payload-processing-e2e-ipp-a-f50f6e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-q746s

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f50f6e-64658675d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f50f6e-64658675d-lxsrv

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0fab6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0fab6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f50f6e-64658675d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f50f6e-64658675d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f50f6e: serviceaccount "payload-processing-e2e-ipp-a-f50f6e" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f50f6e-64658675d-lxsrv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f50f6e-64658675d-lxsrv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f50f6e-64658675d-lxsrv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f50f6e-64658675d-lxsrv

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-q746s

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-q746s

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-q746s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-q746s

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-q746s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.647s (2.647s including waiting). Image size: 166612641 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f50f6e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f50f6e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0fab6d-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

openshift-ingress

deployment-controller

e2e-api-a-0fab6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-0fab6d-openshift-default-78c469c695 from 4 to 8

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

Started

Container started

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

Created

Container created

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-31407e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-31407e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

Created

Container created

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

Started

Container started

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

Started

Container started

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

Created

Container created

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

Started

Container started

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-b-bc5d8f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-bc5d8f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-bc5d8f

openshift-ingress

replicaset-controller

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5

SuccessfulCreate

Created pod: e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

openshift-ingress

multus

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

ProbeError

Startup probe error: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

Unhealthy

Startup probe failed: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4-cgd7c

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-bc5d8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-bc5d8f: serviceaccount "payload-processing-e2e-ipp-b-bc5d8f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-bc5d8f: serviceaccount "payload-processing-e2e-ipp-b-bc5d8f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c-4tjvd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-bc5d8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-0fab6d-798fc6fdb4-82s44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0fab6d-5b4ffc9499-d8msd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-532f3b-f7756d44c-zql6j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c-4tjvd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c-4tjvd

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-532f3b-bf7fb9ddb-ddn7f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c-4tjvd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c-4tjvd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4-cgd7c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4-cgd7c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4-cgd7c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4-cgd7c

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

openshift-ingress

replicaset-controller

e2e-api-a-0fab6d-openshift-default-78c469c695

SuccessfulCreate

(combined from similar events): Created pod: e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0fab6d-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-api-a-0fab6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-0fab6d-openshift-default-78c469c695 from 8 to 10

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

Started

Container started

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

Created

Container created

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

Started

Container started

openshift-ingress

multus

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulDelete

Deleted pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulDelete

Deleted pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-wk7pf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulDelete

Deleted pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-p98mh

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulDelete

Deleted pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pnd9j

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 10 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x7)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-zpvwl

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-532f3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-532f3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a55a4b-665d74b76b-6rnkx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a55a4b-6479dd9979-tw8gm

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

ProbeError

Readiness probe error: Get "http://10.132.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

Unhealthy

Readiness probe failed: Get "http://10.132.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8272af-6c8fcd9cb7-9lnl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8272af-64c9997f4b-8kzwk

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-532f3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667-hlgh5
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-532f3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-532f3b-65596d649b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-532f3b: serviceaccount "payload-processing-e2e-ipp-a-532f3b" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-532f3b-65596d649b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-532f3b-65596d649b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-532f3b: serviceaccount "payload-processing-e2e-ipp-a-532f3b" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667-hlgh5

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-532f3b-65596d649b-6cng2

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-532f3b-65596d649b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-532f3b-65596d649b-6cng2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667-hlgh5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667-hlgh5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-532f3b-65596d649b-6cng2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667-hlgh5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-532f3b-65596d649b-6cng2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-532f3b-65596d649b-6cng2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a55a4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a55a4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-31407e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-31407e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

Unhealthy

Startup probe failed: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

ProbeError

Startup probe error: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a55a4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a55a4b-b845dbd76 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a55a4b-b845dbd76

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a55a4b-b845dbd76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a55a4b: serviceaccount "payload-processing-e2e-ipp-b-a55a4b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a55a4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a55a4b: serviceaccount "payload-processing-e2e-ipp-b-a55a4b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79-nr2z9

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a55a4b-b845dbd76

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a55a4b-b845dbd76-dgs6l

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a55a4b-b845dbd76-dgs6l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79-nr2z9

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c

SuccessfulCreate

Created pod: e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

openshift-ingress

deployment-controller

e2e-ipp-b-f2cf8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a55a4b-b845dbd76-dgs6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-a55a4b-b845dbd76-dgs6l

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79-nr2z9

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a55a4b-b845dbd76-dgs6l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79-nr2z9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f2cf8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f2cf8a

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79-nr2z9

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-532f3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-532f3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8272af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8272af-7979ff4776 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8272af-7979ff4776

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8272af-7979ff4776-bqhjl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8272af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8272af-7979ff4776

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8272af-7979ff4776-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8272af: serviceaccount "payload-processing-e2e-ipp-b-8272af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc-r4f97
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8272af: serviceaccount "payload-processing-e2e-ipp-b-8272af" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc-r4f97

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc-r4f97

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8272af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-ipp-b-8272af-7979ff4776-bqhjl

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8272af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc-r4f97

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc-r4f97

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8272af-7979ff4776-bqhjl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8272af-7979ff4776-bqhjl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8272af-7979ff4776-bqhjl

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b-lcq4w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f2cf8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f2cf8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795-9lp9p
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f2cf8a: serviceaccount "payload-processing-e2e-ipp-b-f2cf8a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f2cf8a: serviceaccount "payload-processing-e2e-ipp-b-f2cf8a" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b-lcq4w

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795-9lp9p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795-9lp9p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795-9lp9p

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795-9lp9p

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b-lcq4w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b-lcq4w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b-lcq4w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

Unhealthy

Readiness probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

ProbeError

Readiness probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bc5d8f-7fb8b5d94c-4tjvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bc5d8f-86885bc9c4-cgd7c

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a55a4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a55a4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8272af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8272af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-bc5d8f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-bc5d8f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8sgwc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-8kwrr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-gwqtq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-v4jkl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-d59rf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-2c5n6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-wfhsw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-t9kjd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-6zhnb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-0fab6d-openshift-default-78c469c695-jrn96

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-584c9d-7cf7cb4b67-qhcgf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-584c9d-5947df7d8-g6p5b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-31407e-5969d8795-tl5rd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-31407e-78c4f67fb8-nkhjz

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-bc5d8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-bc5d8f-755ff454bd from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-584c9d-openshift-default-7756f8d445-96rdf

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-bc5d8f: serviceaccount "payload-processing-e2e-ipp-b-bc5d8f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-bc5d8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c-s8wxt

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-bc5d8f-755ff454bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-bc5d8f-755ff454bd-zz2pm
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-bc5d8f-755ff454bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-bc5d8f-755ff454bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-bc5d8f: serviceaccount "payload-processing-e2e-ipp-b-bc5d8f" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-bc5d8f-755ff454bd-zz2pm

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c-s8wxt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bc5d8f-755ff454bd-zz2pm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bc5d8f-755ff454bd-zz2pm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bc5d8f-755ff454bd-zz2pm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c-s8wxt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c-s8wxt

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c-s8wxt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-33c99c-5f5c495f66-hmmgf

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-bc5d8f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-33c99c-74989c67f-hs88d

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-bc5d8f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8272af-7979ff4776-bqhjl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8272af-b7cbd96bc-r4f97

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

ProbeError

Readiness probe error: Get "http://10.132.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

Unhealthy

Readiness probe failed: Get "http://10.132.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-33c99c-openshift-default-66f697958c-spgdl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2cf8a-7f489f7795-9lp9p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2cf8a-84c74d6b8b-lcq4w

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-8272af-openshift-default-955c6877-zjm8j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-520bc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-520bc4

openshift-ingress

deployment-controller

e2e-praxis-a-520bc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-520bc4-openshift-default-77fb485c89 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-520bc4-openshift-default-77fb485c89

SuccessfulCreate

Created pod: e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

openshift-ingress

multus

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f50f6e-5f8747bcd7-q746s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f50f6e-64658675d-lxsrv

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

ProbeError

Startup probe error: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

Unhealthy

Startup probe failed: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f2cf8a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f2cf8a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-520bc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-520bc4-59bf859948 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-520bc4: serviceaccount "payload-processing-e2e-praxis-a-520bc4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf-86gjt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-520bc4-59bf859948

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-520bc4-59bf859948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-520bc4: serviceaccount "payload-processing-e2e-praxis-a-520bc4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-520bc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-520bc4-59bf859948

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-520bc4-59bf859948-fn4xc

openshift-ingress

multus

payload-processing-e2e-praxis-a-520bc4-59bf859948-fn4xc

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf-86gjt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf-86gjt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-520bc4-59bf859948-fn4xc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-520bc4-59bf859948-fn4xc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-520bc4-59bf859948-fn4xc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf-86gjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf-86gjt

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f50f6e-openshift-default-fcbf8bcd7-dm45m

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f2cf8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f2cf8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c-2mrrj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68-7w5m9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f2cf8a: serviceaccount "payload-processing-e2e-ipp-b-f2cf8a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c-2mrrj

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c-2mrrj

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f2cf8a: serviceaccount "payload-processing-e2e-ipp-b-f2cf8a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68-7w5m9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68-7w5m9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68-7w5m9

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68-7w5m9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c-2mrrj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c-2mrrj

Created

Container created

openshift-ingress

kubelet

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-31407e-openshift-default-6bf5cb57c5-7qnsh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-bbd0e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-bbd0e5

openshift-ingress

replicaset-controller

e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf

SuccessfulCreate

Created pod: e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn

openshift-ingress

kubelet

e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn

Started

Container started

openshift-ingress

multus

e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn

AddedInterface

Add eth0 [10.132.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-a-bbd0e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f2cf8a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f2cf8a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-bbd0e5-64d48998dd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-bbd0e5-64d48998dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-bbd0e5: serviceaccount "payload-processing-e2e-praxis-a-bbd0e5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-bbd0e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-bbd0e5-64d48998dd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-bbd0e5-64d48998dd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-bbd0e5-64d48998dd-ngp6k
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-bbd0e5: serviceaccount "payload-processing-e2e-praxis-a-bbd0e5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c-p2rcl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-bbd0e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-bbd0e5-64d48998dd-ngp6k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c-p2rcl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-bbd0e5-64d48998dd-ngp6k

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c-p2rcl

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c-p2rcl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-bbd0e5-64d48998dd-ngp6k

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-bbd0e5-64d48998dd-ngp6k

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c-p2rcl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a55a4b-846f47dc79-nr2z9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a55a4b-b845dbd76-dgs6l

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-bbd0e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-bbd0e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-a55a4b-openshift-default-687bcbd8d9-r4g9b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bc5d8f-755ff454bd-zz2pm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bc5d8f-6c6459c4c-s8wxt

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f

SuccessfulCreate

Created pod: e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-dfa2ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-dfa2ae

openshift-ingress

deployment-controller

e2e-praxis-a-dfa2ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f from 0 to 1

openshift-ingress

multus

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-dfa2ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-2h2tp

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-dfa2ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-dfa2ae-7dcff65486 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-dfa2ae-7dcff65486

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-zmfxz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-dfa2ae-7dcff65486

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-dfa2ae: serviceaccount "payload-processing-e2e-praxis-a-dfa2ae" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-dfa2ae: serviceaccount "payload-processing-e2e-praxis-a-dfa2ae" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-2h2tp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-2h2tp

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-bbd0e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-bbd0e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-2h2tp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-2h2tp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-zmfxz

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-zmfxz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-zmfxz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-zmfxz

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c

SuccessfulCreate

Created pod: e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-93c22e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-93c22e

openshift-ingress

deployment-controller

e2e-praxis-a-93c22e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-93c22e-openshift-default-6f6d74d55c from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-bc5d8f-openshift-default-65566bcdd5-2wk4l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-4dd310

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-4dd310

openshift-ingress

deployment-controller

e2e-praxis-b-4dd310-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c

SuccessfulCreate

Created pod: e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-93c22e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-93c22e-55546fbb88 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-93c22e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-93c22e-6dff459747 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-93c22e-55546fbb88

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-93c22e-55546fbb88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-93c22e: serviceaccount "payload-processing-e2e-praxis-a-93c22e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-93c22e-6dff459747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-93c22e-6dff459747-tfd4r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-93c22e-6dff459747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-93c22e-6dff459747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-93c22e: serviceaccount "payload-processing-e2e-praxis-a-93c22e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-93c22e-55546fbb88

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-93c22e-55546fbb88-9nmfw

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-93c22e-6dff459747-tfd4r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-93c22e-55546fbb88-9nmfw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-93c22e-55546fbb88-9nmfw

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-93c22e-6dff459747-tfd4r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-93c22e-6dff459747-tfd4r

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-93c22e-55546fbb88-9nmfw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-93c22e-55546fbb88-9nmfw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-93c22e-6dff459747-tfd4r

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

ProbeError

Readiness probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-4dd310

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-4dd310-555f786c8 from 0 to 1

openshift-ingress

kubelet

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

Unhealthy

Readiness probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4dd310: serviceaccount "payload-processing-e2e-praxis-b-4dd310" not found

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-q47h9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-54g5w

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4dd310-555f786c8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-4dd310-555f786c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4dd310: serviceaccount "payload-processing-e2e-praxis-b-4dd310" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-rrwcn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4dd310-555f786c8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-4dd310-555f786c8-v5rcr

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 10 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q47h9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-4dd310

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555-ml7gb

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-54g5w

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-rrwcn

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4dd310-555f786c8-v5rcr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555-ml7gb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555-ml7gb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-4dd310-555f786c8-v5rcr

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555-ml7gb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555-ml7gb

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4dd310-555f786c8-v5rcr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4dd310-555f786c8-v5rcr

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

ProbeError

Startup probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

Unhealthy

Startup probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-praxis-b-f6a022-openshift-default-6bb89969c

SuccessfulCreate

Created pod: e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-f6a022

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f6a022

openshift-ingress

deployment-controller

e2e-praxis-b-f6a022-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f6a022-openshift-default-6bb89969c from 0 to 1

openshift-ingress

multus

e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dfa2ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dfa2ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-520bc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-520bc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-f6a022

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f6a022-597b4db76

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-f6a022-597b4db76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f6a022: serviceaccount "payload-processing-e2e-praxis-b-f6a022" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f6a022-597b4db76

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-f6a022-597b4db76-hf2jj
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f6a022: serviceaccount "payload-processing-e2e-praxis-b-f6a022" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f-zcw9z

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-f6a022

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-f6a022-597b4db76 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f-zcw9z

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f-zcw9z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f6a022-597b4db76-hf2jj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f6a022-597b4db76-hf2jj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f6a022-597b4db76-hf2jj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f-zcw9z

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-f6a022-597b4db76-hf2jj

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f-zcw9z

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 5 to 4
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-520bc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-520bc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-dls9h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-praxis-b-5a6371-openshift-default-786c45cf4f

SuccessfulCreate

Created pod: e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c

openshift-ingress

deployment-controller

e2e-praxis-b-5a6371-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-5a6371-openshift-default-786c45cf4f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-5a6371

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-5a6371

openshift-ingress

multus

e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

ProbeError

Readiness probe error: Get "http://10.132.0.204:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

openshift-ingress

kubelet

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

Unhealthy

Readiness probe failed: Get "http://10.132.0.204:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-6s667

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 5 to 4

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-5a6371

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-5a6371-84f5455bfb from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

ProbeError

Readiness probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-5a6371

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-5a6371-86957fc887 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-5a6371-86957fc887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-5a6371-86957fc887-7h9c5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-5a6371-86957fc887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-5a6371-86957fc887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-5a6371: serviceaccount "payload-processing-e2e-praxis-b-5a6371" not found

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulDelete

Deleted pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-5a6371-84f5455bfb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-5a6371-84f5455bfb-fkrt4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-5a6371-84f5455bfb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-5a6371-84f5455bfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-5a6371: serviceaccount "payload-processing-e2e-praxis-b-5a6371" not found

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

Unhealthy

Readiness probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-b4w26

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-5a6371-86957fc887-7h9c5

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5a6371-84f5455bfb-fkrt4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-5a6371-84f5455bfb-fkrt4

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5a6371-86957fc887-7h9c5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5a6371-86957fc887-7h9c5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5a6371-86957fc887-7h9c5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5a6371-84f5455bfb-fkrt4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5a6371-84f5455bfb-fkrt4

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

ProbeError

Startup probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

Unhealthy

Startup probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

Unhealthy

Startup probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

ProbeError

Startup probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-93c22e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-93c22e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-b-a035a3-openshift-default-799cf89fc

SuccessfulCreate

Created pod: e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

openshift-ingress

deployment-controller

e2e-praxis-b-a035a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-a035a3-openshift-default-799cf89fc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-a035a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-a035a3

openshift-ingress

multus

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-vtxpg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447-lx4lq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a035a3: serviceaccount "payload-processing-e2e-praxis-b-a035a3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-a035a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-a035a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-a035a3-557b7d66b8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a035a3-557b7d66b8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-a035a3-557b7d66b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a035a3: serviceaccount "payload-processing-e2e-praxis-b-a035a3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a035a3-557b7d66b8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-a035a3-557b7d66b8-cd2hn

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulDelete

Deleted pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a035a3-557b7d66b8-cd2hn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447-lx4lq

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a035a3-557b7d66b8-cd2hn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447-lx4lq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447-lx4lq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447-lx4lq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a035a3-557b7d66b8-cd2hn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-a035a3-557b7d66b8-cd2hn

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-ghs74

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cjmgh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-93c22e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-93c22e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-520bc4-59bf859948-fn4xc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-520bc4-6f768cffcf-86gjt

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4dd310-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4dd310-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulDelete

Deleted pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-hb4pc

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulDelete

Deleted pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n
(x6)

openshift-ingress

kubelet

e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk

ProbeError

Startup probe error: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pb87n

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk

Unhealthy

Startup probe failed: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2q89w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-2q89w

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 7 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f6a022-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f6a022-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dfa2ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dfa2ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-bbd0e5-64d48998dd-ngp6k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-bbd0e5-77945bd86c-p2rcl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn

ProbeError

Readiness probe error: Get "http://10.132.0.198:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn

Unhealthy

Readiness probe failed: Get "http://10.132.0.198:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-bbd0e5-openshift-default-7d48679bbf-kdltn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f6a022-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f6a022-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-520bc4-openshift-default-77fb485c89-nqtp2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f6a022-d75d4949f-zcw9z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f6a022-597b4db76-hf2jj

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-532f3b-7b46c6c667-hlgh5

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5a6371-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5a6371-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-532f3b-65596d649b-6cng2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4dd310-555f786c8-v5rcr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4dd310-c5d7c7555-ml7gb

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4dd310-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4dd310-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a035a3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a035a3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-f6a022-openshift-default-6bb89969c-mflng

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-93c22e-55546fbb88-9nmfw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-93c22e-6dff459747-tfd4r

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulDelete

Deleted pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulDelete

Deleted pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-z5fxh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 5 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-532f3b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-a-532f3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-tmbhl

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c

SuccessfulCreate

Created pod: e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-tmbhl

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-7694w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-tmbhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-tmbhl

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-tmbhl

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5a6371-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5a6371-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-4dd310-openshift-default-7ffc75bf7c-l2dkk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-93c22e-openshift-default-6f6d74d55c-5nmfg

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a035a3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a035a3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-tmbhl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-532f3b-openshift-default-5dcf76cb9c-4s6km

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a035a3-557b7d66b8-cd2hn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a035a3-7cf78c4447-lx4lq

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz

AddedInterface

Add eth0 [10.132.0.231/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 1 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulCreate

Created pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulCreate

Created pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

openshift-ingress

multus

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

Created

Container created

openshift-ingress

multus

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l

ProbeError

Startup probe error: Get "http://10.132.0.230:15021/healthz/ready": dial tcp 10.132.0.230:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz

ProbeError

Startup probe error: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz

Unhealthy

Startup probe failed: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l

Unhealthy

Startup probe failed: Get "http://10.132.0.230:15021/healthz/ready": dial tcp 10.132.0.230:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

ProbeError

Startup probe error: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

Unhealthy

Startup probe failed: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2cf8a-74b9d4596c-2mrrj

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

ProbeError

Startup probe error: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

Unhealthy

Startup probe failed: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2cf8a-66c6f86c68-7w5m9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

ProbeError

Startup probe error: Get "http://10.132.0.233:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

Unhealthy

Startup probe failed: Get "http://10.132.0.233:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9

Created

Container created

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-f2cf8a-openshift-default-7f46c5657c-tjkc5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-f5e55f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-f5e55f
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

Unhealthy

Startup probe failed: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-praxis-a-f5e55f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f5e55f-openshift-default-698f5b89b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5

SuccessfulCreate

Created pod: e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

openshift-ingress

multus

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

AddedInterface

Add eth0 [10.132.0.239/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

ProbeError

Startup probe error: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-zmfxz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-2h2tp

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-f5e55f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f5e55f: serviceaccount "payload-processing-e2e-praxis-a-f5e55f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-f5e55f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595 from 0 to 1

openshift-ingress

kubelet

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-a035a3-openshift-default-799cf89fc-clmxq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f5e55f: serviceaccount "payload-processing-e2e-praxis-a-f5e55f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6-dmn9k

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595-zhrs2

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6-dmn9k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595-zhrs2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595-zhrs2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6-dmn9k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6-dmn9k

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595-zhrs2

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595-zhrs2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6-dmn9k

AddedInterface

Add eth0 [10.132.0.241/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dfa2ae-7dcff65486-zmfxz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dfa2ae-b68b85d4c-2h2tp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulCreate

Created pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 3 to 6

openshift-ingress

multus

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

AddedInterface

Add eth0 [10.132.0.247/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-b-ec27ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulCreate

Created pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f

SuccessfulCreate

Created pod: e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulCreate

Created pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

openshift-ingress

multus

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulCreate

Created pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ec27ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ec27ed

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

Created

Container created

openshift-ingress

multus

e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs

AddedInterface

Add eth0 [10.132.0.250/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

AddedInterface

Add eth0 [10.132.0.249/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-2ltk7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-2ltk7

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 6 to 5

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

ProbeError

Readiness probe error: Get "http://10.132.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

ProbeError

Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ec27ed: serviceaccount "payload-processing-e2e-praxis-b-ec27ed" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ec27ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ec27ed-5c6485859d from 0 to 1

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

Unhealthy

Readiness probe failed: Get "http://10.132.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ec27ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

Unhealthy

Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455-5hlz4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ec27ed-5c6485859d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ec27ed-5c6485859d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ec27ed: serviceaccount "payload-processing-e2e-praxis-b-ec27ed" not found
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

ProbeError

Startup probe error: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

Unhealthy

Startup probe failed: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ec27ed-5c6485859d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ec27ed-5c6485859d-fxf9c

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455-5hlz4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ec27ed-5c6485859d-fxf9c

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-ec27ed-5c6485859d-fxf9c

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455-5hlz4

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455-5hlz4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455-5hlz4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ec27ed-5c6485859d-fxf9c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ec27ed-5c6485859d-fxf9c

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

Unhealthy

Startup probe failed: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

ProbeError

Startup probe error: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

ProbeError

Startup probe error: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

Unhealthy

Startup probe failed: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5

SuccessfulCreate

Created pod: e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

openshift-ingress

deployment-controller

e2e-shared-a-w1-adcdcb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-adcdcb-openshift-default-85679766c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-adcdcb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-adcdcb

openshift-ingress

multus

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

ProbeError

Readiness probe error: Get "http://10.132.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

Unhealthy

Readiness probe failed: Get "http://10.132.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s

Started

Container started

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

Started

Container started

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 3 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-adcdcb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-98djx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-zhhc9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-adcdcb: serviceaccount "payload-processing-e2e-shared-a-w1-adcdcb" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-adcdcb: serviceaccount "payload-processing-e2e-shared-a-w1-adcdcb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-adcdcb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-zhhc9

AddedInterface

Add eth0 [10.132.1.0/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-98djx

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-98djx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-98djx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-98djx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-zhhc9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-zhhc9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-zhhc9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

ProbeError

Startup probe error: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f5e55f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

Unhealthy

Startup probe failed: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f5e55f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

Created

Container created
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 6 to 8

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

AddedInterface

Add eth0 [10.132.1.4/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75

SuccessfulCreate

Created pod: e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-645f2b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-645f2b

openshift-ingress

deployment-controller

e2e-shared-a-w3-645f2b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-645f2b-openshift-default-78db55bf75 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

AddedInterface

Add eth0 [10.132.1.7/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

Unhealthy

Startup probe failed: Get "http://10.132.1.4:15021/healthz/ready": dial tcp 10.132.1.4:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

ProbeError

Startup probe error: Get "http://10.132.1.4:15021/healthz/ready": dial tcp 10.132.1.4:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

ProbeError

Readiness probe error: Get "http://10.132.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-adcdcb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-dfa2ae-openshift-default-cfbb6844f-q8fj4

Unhealthy

Readiness probe failed: Get "http://10.132.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-adcdcb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

Unhealthy

Startup probe failed: Get "http://10.132.1.4:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-645f2b: serviceaccount "payload-processing-e2e-shared-a-w3-645f2b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-645f2b: serviceaccount "payload-processing-e2e-shared-a-w3-645f2b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-645f2b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-645f2b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

ProbeError

Startup probe error: Get "http://10.132.1.4:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-b97d5

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-b97d5

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-jq6b2

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-b97d5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-jq6b2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-b97d5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-jq6b2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-jq6b2

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-jq6b2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-b97d5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5a6371-86957fc887-7h9c5

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-6e2548

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-6e2548

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5a6371-84f5455bfb-fkrt4

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-a-w2-6e2548-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-6e2548-openshift-default-86665b47c5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-6e2548-openshift-default-86665b47c5

SuccessfulCreate

Created pod: e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n

openshift-ingress

multus

e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f5e55f-d4dd84595-zhrs2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f5e55f-7c9f44cdf6-dmn9k

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6e2548: serviceaccount "payload-processing-e2e-shared-a-w2-6e2548" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6e2548-6647c5c56

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-8km4m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-6e2548

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-d7bll

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-6e2548

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-6e2548-6647c5c56 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6e2548-6647c5c56

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6e2548: serviceaccount "payload-processing-e2e-shared-a-w2-6e2548" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-d7bll

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-d7bll

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-nnt77

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-8km4m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-8km4m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-8km4m

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-d7bll

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-d7bll

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-8km4m

AddedInterface

Add eth0 [10.132.1.12/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875

SuccessfulCreate

Created pod: e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

openshift-ingress

deployment-controller

e2e-shared-b-w1-fa5a69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-fa5a69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-fa5a69

openshift-ingress

multus

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

AddedInterface

Add eth0 [10.132.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nnt77

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-5a6371-openshift-default-786c45cf4f-t224c

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulCreate

Created pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 8 to 10

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-4f3973

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-4f3973

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

Started

Container started

openshift-ingress

multus

e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w0-4f3973-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c

SuccessfulCreate

Created pod: e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

AddedInterface

Add eth0 [10.132.1.14/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-fa5a69: serviceaccount "payload-processing-e2e-shared-b-w1-fa5a69" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-fa5a69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-zpmgn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-fa5a69: serviceaccount "payload-processing-e2e-shared-b-w1-fa5a69" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-vgdqq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-fa5a69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-vgdqq

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-vgdqq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-vgdqq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-vgdqq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-zpmgn

AddedInterface

Add eth0 [10.132.1.15/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-zpmgn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-zpmgn

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-4f3973: serviceaccount "payload-processing-e2e-shared-a-w0-4f3973" not found

openshift-ingress

kubelet

e2e-praxis-a-f5e55f-openshift-default-698f5b89b5-pf77z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-4f3973

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-zpmgn

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-4f3973

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-48kw6
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-47czd
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-4f3973: serviceaccount "payload-processing-e2e-shared-a-w0-4f3973" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-47czd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-48kw6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-48kw6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-48kw6

AddedInterface

Add eth0 [10.132.1.17/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-47czd

AddedInterface

Add eth0 [10.132.1.18/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-48kw6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-47czd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-47czd

Created

Container created
(x10)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

ProbeError

Startup probe error: Get "http://10.132.1.14:15021/healthz/ready": dial tcp 10.132.1.14:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

Unhealthy

Startup probe failed: Get "http://10.132.1.14:15021/healthz/ready": dial tcp 10.132.1.14:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

ProbeError

Readiness probe error: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

Unhealthy

Readiness probe failed: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ec27ed-866f5c6455-5hlz4

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ec27ed-5c6485859d-fxf9c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulDelete

Deleted pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-9s7l6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 3 to 2
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

Unhealthy

Startup probe failed: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

ProbeError

Startup probe error: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-30fbb6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-30fbb6

openshift-ingress

replicaset-controller

e2e-shared-b-w3-30fbb6-openshift-default-df9656985

SuccessfulCreate

Created pod: e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx

openshift-ingress

deployment-controller

e2e-shared-b-w3-30fbb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-30fbb6-openshift-default-df9656985 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx

AddedInterface

Add eth0 [10.132.1.19/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-30fbb6: serviceaccount "payload-processing-e2e-shared-b-w3-30fbb6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-30fbb6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-30fbb6: serviceaccount "payload-processing-e2e-shared-b-w3-30fbb6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-30fbb6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-n2wxw

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-7g7mz

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-7g7mz

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-7g7mz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-7g7mz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-7g7mz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ec27ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ec27ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs

ProbeError

Startup probe error: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs

Unhealthy

Startup probe failed: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-n2wxw

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-n2wxw

AddedInterface

Add eth0 [10.132.1.20/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-n2wxw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-n2wxw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-868b1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-868b1f

openshift-ingress

kubelet

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

Unhealthy

Readiness probe failed: Get "http://10.132.1.7:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

ProbeError

Readiness probe error: Get "http://10.132.1.7:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-868b1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9

SuccessfulCreate

Created pod: e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

openshift-ingress

multus

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

AddedInterface

Add eth0 [10.132.1.21/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-ec27ed-openshift-default-676b7d8b4f-mghzs

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-6e2548-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-6e2548-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-868b1f: serviceaccount "payload-processing-e2e-shared-b-w2-868b1f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-868b1f: serviceaccount "payload-processing-e2e-shared-b-w2-868b1f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-868b1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-sp6f7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-868b1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-sp6f7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-xj5b7

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-xj5b7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-xj5b7

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-sp6f7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-sp6f7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-sp6f7

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-xj5b7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-xj5b7

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

ProbeError

Startup probe error: Get "http://10.132.1.7:15021/healthz/ready": dial tcp 10.132.1.7:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

Unhealthy

Startup probe failed: Get "http://10.132.1.7:15021/healthz/ready": dial tcp 10.132.1.7:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n

ProbeError

Startup probe error: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n

Unhealthy

Startup probe failed: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-explicit-3bbfc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-3bbfc8

openshift-ingress

replicaset-controller

e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5

SuccessfulCreate

Created pod: e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9

openshift-ingress

deployment-controller

e2e-explicit-3bbfc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5 from 0 to 1

openshift-ingress

multus

e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9

AddedInterface

Add eth0 [10.132.1.22/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-b9ff93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-b9ff93

openshift-ingress

replicaset-controller

e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c

SuccessfulCreate

Created pod: e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9

openshift-ingress

multus

e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w0-b9ff93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

Unhealthy

Readiness probe failed: Get "http://10.132.1.13:15021/healthz/ready": read tcp 10.132.0.2:41954->10.132.1.13:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

ProbeError

Readiness probe error: Get "http://10.132.1.13:15021/healthz/ready": read tcp 10.132.0.2:41954->10.132.1.13:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-3bbfc8-7fdcdbf498

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-3bbfc8-7fdcdbf498-7zzq2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-3bbfc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c-rnmrm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-3bbfc8: serviceaccount "payload-processing-e2e-explicit-3bbfc8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-3bbfc8-7fdcdbf498

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-3bbfc8-7fdcdbf498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-3bbfc8: serviceaccount "payload-processing-e2e-explicit-3bbfc8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-3bbfc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-3bbfc8-7fdcdbf498 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

Started

Container started

openshift-ingress

multus

payload-processing-e2e-explicit-3bbfc8-7fdcdbf498-7zzq2

AddedInterface

Add eth0 [10.132.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c-rnmrm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4f3973-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4f3973-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c-rnmrm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c-rnmrm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c-rnmrm

AddedInterface

Add eth0 [10.132.1.23/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-3bbfc8-7fdcdbf498-7zzq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-3bbfc8-7fdcdbf498-7zzq2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-3bbfc8-7fdcdbf498-7zzq2

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-b9ff93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-w8ll9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-b9ff93: serviceaccount "payload-processing-e2e-shared-b-w0-b9ff93" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-b9ff93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-9lzbh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-b9ff93: serviceaccount "payload-processing-e2e-shared-b-w0-b9ff93" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-9lzbh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-w8ll9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-w8ll9

AddedInterface

Add eth0 [10.132.1.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-w8ll9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-9lzbh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-9lzbh

AddedInterface

Add eth0 [10.132.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-w8ll9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-9lzbh

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-645f2b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-645f2b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

ProbeError

Startup probe error: Get "http://10.132.1.13:15021/healthz/ready": dial tcp 10.132.1.13:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

Unhealthy

Startup probe failed: Get "http://10.132.1.13:15021/healthz/ready": dial tcp 10.132.1.13:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-fa5a69-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-fa5a69-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-fa5a69-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-fa5a69-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx

ProbeError

Startup probe error: Get "http://10.132.1.19:15021/healthz/ready": dial tcp 10.132.1.19:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx

Unhealthy

Startup probe failed: Get "http://10.132.1.19:15021/healthz/ready": dial tcp 10.132.1.19:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4f3973-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-4f3973-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

Unhealthy

Startup probe failed: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

ProbeError

Startup probe error: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-9jxv8

openshift-ingress

multus

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875

SuccessfulCreate

Created pod: e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

openshift-ingress

deployment-controller

e2e-shared-b-w1-fa5a69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875 from 1 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-30fbb6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-30fbb6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-9jxv8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-fa5a69-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulDelete

Deleted pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-sp2jq
(x2)

openshift-ingress

kubelet

e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-3bbfc8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-3bbfc8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-868b1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-868b1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-b9ff93-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-b9ff93-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9

Unhealthy

Startup probe failed: Get "http://10.132.1.22:15021/healthz/ready": dial tcp 10.132.1.22:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9

ProbeError

Startup probe error: Get "http://10.132.1.22:15021/healthz/ready": dial tcp 10.132.1.22:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-3bbfc8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-3bbfc8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-b9ff93-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-b9ff93-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-explicit-3bbfc8-7fdcdbf498-7zzq2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3bbfc8-6554f4994c-rnmrm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-3bbfc8-openshift-default-6cfd58d8d5-752v9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-b8b590-openshift-default-9bdfcd69

SuccessfulCreate

Created pod: e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b

openshift-ingress

gateway_labeler_controller

e2e-noten-b8b590

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-b8b590

openshift-ingress

deployment-controller

e2e-noten-b8b590-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-b8b590-openshift-default-9bdfcd69 from 0 to 1

openshift-ingress

kubelet

e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b

Started

Container started

openshift-ingress

kubelet

e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b

Created

Container created

openshift-ingress

kubelet

e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b

AddedInterface

Add eth0 [10.132.1.39/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-b8b590-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-b8b590-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-645f2b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-645f2b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-b8b590-openshift-default-9bdfcd69-hzk2b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-adcdcb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-adcdcb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-868b1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-868b1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-30fbb6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-30fbb6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-6e2548-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-6e2548-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7315-c172b3

Created

Container created

opendatahub

kubelet

test-curl-7315-c172b3

Started

Container started

opendatahub

kubelet

test-curl-7315-c172b3

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7315-c172b3

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

opendatahub

multus

test-curl-7315-9d5726

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7315-9d5726

Started

Container started

opendatahub

kubelet

test-curl-7315-9d5726

Created

Container created

opendatahub

kubelet

test-curl-7315-9d5726

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7324-6ab4a8

AddedInterface

Add eth0 [10.132.1.42/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7324-6ab4a8

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7315-c172b3

Killing

Stopping container test-curl-7315-c172b3

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulDelete

Deleted pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

opendatahub

multus

test-curl-7315-5c3a6d

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

opendatahub

kubelet

test-curl-7315-5c3a6d

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7315-5c3a6d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-fkfdj

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7315-5c3a6d

Started

Container started

opendatahub

kubelet

test-curl-7324-6ab4a8

Started

Container started

opendatahub

kubelet

test-curl-7315-9d5726

Killing

Stopping container test-curl-7315-9d5726

opendatahub

kubelet

test-curl-7324-6ab4a8

Created

Container created

opendatahub

kubelet

test-curl-7324-6ab4a8

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.648s (2.648s including waiting). Image size: 106100986 bytes.

opendatahub

multus

test-curl-7315-69263c

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7315-69263c

Started

Container started

opendatahub

kubelet

test-curl-7315-69263c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7315-69263c

Created

Container created

opendatahub

kubelet

test-curl-7315-5c3a6d

Killing

Stopping container test-curl-7315-5c3a6d

opendatahub

kubelet

test-curl-7324-6ab4a8

Killing

Stopping container test-curl-7324-6ab4a8

openshift-ingress

deployment-controller

e2e-extmod-a-2d2923-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-2d2923-openshift-default-5b69647fb5 from 0 to 1

opendatahub

kubelet

test-curl-7315-69263c

Killing

Stopping container test-curl-7315-69263c

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-2d2923

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-2d2923

openshift-ingress

replicaset-controller

e2e-extmod-a-2d2923-openshift-default-5b69647fb5

SuccessfulCreate

Created pod: e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-b8ca49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-b8ca49

openshift-ingress

deployment-controller

e2e-extmod-a-b8ca49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-b8ca49-openshift-default-7d467d9545 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-b8ca49-openshift-default-7d467d9545

SuccessfulCreate

Created pod: e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk

openshift-ingress

multus

e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6

AddedInterface

Add eth0 [10.132.1.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-gtbzz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-65q26

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-cwk4l
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-b8ca49: serviceaccount "payload-processing-e2e-extmod-a-b8ca49" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-ncd8b

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-b8ca49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-b8ca49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-zc52v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-b8ca49: serviceaccount "payload-processing-e2e-extmod-a-b8ca49" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2d2923-6d6d74576d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-2d2923-6d6d74576d-l294v

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-zc52v

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2d2923-6d6d74576d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-2d2923-6d6d74576d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2d2923: serviceaccount "payload-processing-e2e-extmod-a-2d2923" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-ncd8b

AddedInterface

Add eth0 [10.132.1.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-zc52v

AddedInterface

Add eth0 [10.132.1.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-zc52v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-2d2923

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-2d2923-6d6d74576d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-zc52v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-ncd8b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-ncd8b

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2d2923: serviceaccount "payload-processing-e2e-extmod-a-2d2923" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-jn9z2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-2d2923

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-ncd8b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-jn9z2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2d2923-6d6d74576d-l294v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2d2923-6d6d74576d-l294v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2d2923-6d6d74576d-l294v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-jn9z2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-jn9z2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-jn9z2

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-2d2923-6d6d74576d-l294v

AddedInterface

Add eth0 [10.132.1.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulDelete

Deleted pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wl5qt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-b4hdt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7318-f1b6c5

Created

Container created

opendatahub

kubelet

test-curl-7318-f1b6c5

Started

Container started

opendatahub

multus

test-curl-7318-f1b6c5

AddedInterface

Add eth0 [10.132.1.51/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7318-f1b6c5

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-f0145f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-f0145f

openshift-ingress

deployment-controller

e2e-extmod-a-f0145f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f

SuccessfulCreate

Created pod: e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr
(x5)

openshift-ingress

kubelet

e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

openshift-ingress

multus

e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr

AddedInterface

Add eth0 [10.132.1.52/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-9slg5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-cbvkh

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7318-f1b6c5

Killing

Stopping container test-curl-7318-f1b6c5
(x5)

openshift-ingress

kubelet

e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6

Unhealthy

Startup probe failed: Get "http://10.132.1.43:15021/healthz/ready": dial tcp 10.132.1.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6

ProbeError

Startup probe error: Get "http://10.132.1.43:15021/healthz/ready": dial tcp 10.132.1.43:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ad1661

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ad1661

openshift-ingress

deployment-controller

e2e-extmod-b-a0083e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a0083e-openshift-default-5bb4897bcc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-69f3fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-69f3fa

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-a0083e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-a0083e

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

AddedInterface

Add eth0 [10.132.1.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

AddedInterface

Add eth0 [10.132.1.54/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

AddedInterface

Add eth0 [10.132.1.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-mp68x

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-f0145f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-f0145f-78879f4dd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-f0145f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-f0145f: serviceaccount "payload-processing-e2e-extmod-a-f0145f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-f0145f-78879f4dd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-f0145f-78879f4dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-f0145f: serviceaccount "payload-processing-e2e-extmod-a-f0145f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-f0145f-78879f4dd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-f0145f-78879f4dd-8cbb4

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-mp68x

AddedInterface

Add eth0 [10.132.1.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-mp68x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f0145f-78879f4dd-8cbb4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-mp68x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-mp68x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f0145f-78879f4dd-8cbb4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f0145f-78879f4dd-8cbb4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-f0145f-78879f4dd-8cbb4

AddedInterface

Add eth0 [10.132.1.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ad1661

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99-k9dns

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ad1661

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ad1661-7949885446 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ad1661-7949885446

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ad1661-7949885446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ad1661: serviceaccount "payload-processing-e2e-extmod-a-ad1661" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ad1661-7949885446

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ad1661-7949885446-5w8j8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ad1661: serviceaccount "payload-processing-e2e-extmod-a-ad1661" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-b8ca49-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-b8ca49-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2d2923-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99-k9dns

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2d2923-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99-k9dns

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ad1661-7949885446-5w8j8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99-k9dns

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99-k9dns

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ad1661-7949885446-5w8j8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ad1661-7949885446-5w8j8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-ad1661-7949885446-5w8j8

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-a0083e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-a0083e-d588694d8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-a0083e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a0083e: serviceaccount "payload-processing-e2e-extmod-b-a0083e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a0083e-d588694d8

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-a0083e-d588694d8-kzrwp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a0083e-d588694d8

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-a0083e-d588694d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a0083e: serviceaccount "payload-processing-e2e-extmod-b-a0083e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-tv9f9

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a0083e-d588694d8-kzrwp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-69f3fa-584957b64d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-69f3fa-584957b64d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-69f3fa: serviceaccount "payload-processing-e2e-extmod-b-69f3fa" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a0083e-d588694d8-kzrwp

Started

Container started

opendatahub

kubelet

test-curl-7312-1a493a

Created

Container created

opendatahub

multus

test-curl-7312-1a493a

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7312-1a493a

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-tv9f9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-tv9f9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-tv9f9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-tv9f9

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a0083e-d588694d8-kzrwp

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-69f3fa: serviceaccount "payload-processing-e2e-extmod-b-69f3fa" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-a0083e-d588694d8-kzrwp

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-69f3fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-69f3fa-584957b64d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-69f3fa-584957b64d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-69f3fa-584957b64d-7cdxt

opendatahub

kubelet

test-curl-7312-1a493a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7-8cxxl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-69f3fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-69f3fa-584957b64d-7cdxt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-69f3fa-584957b64d-7cdxt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-69f3fa-584957b64d-7cdxt

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-69f3fa-584957b64d-7cdxt

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7-8cxxl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7-8cxxl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7-8cxxl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7-8cxxl

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7312-1a493a

Killing

Stopping container test-curl-7312-1a493a

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6g2sk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-6g2sk
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2d2923-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2d2923-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-b8ca49-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-b8ca49-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-autores-a88d7d-openshift-default-5bf49799d7

SuccessfulCreate

Created pod: e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

openshift-ingress

gateway_labeler_controller

e2e-autores-a88d7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-a88d7d

openshift-ingress

deployment-controller

e2e-autores-a88d7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-a88d7d-openshift-default-5bf49799d7 from 0 to 1

openshift-ingress

multus

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

AddedInterface

Add eth0 [10.132.1.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-a88d7d-7d7f79555b-gkqr7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-a88d7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-a88d7d-784b755d79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-a88d7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-a88d7d-7d7f79555b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a88d7d-7d7f79555b

FailedCreate

Error creating: pods "payload-processing-e2e-autores-a88d7d-7d7f79555b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a88d7d: serviceaccount "payload-processing-e2e-autores-a88d7d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a88d7d-7d7f79555b

SuccessfulCreate

Created pod: payload-processing-e2e-autores-a88d7d-7d7f79555b-gkqr7

openshift-ingress

multus

payload-processing-e2e-autores-a88d7d-7d7f79555b-gkqr7

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a88d7d-784b755d79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-a88d7d-784b755d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a88d7d: serviceaccount "payload-processing-e2e-autores-a88d7d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a88d7d-784b755d79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-a88d7d-784b755d79-qvjj8

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a88d7d-784b755d79-qvjj8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a88d7d-784b755d79-qvjj8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-autores-a88d7d-784b755d79-qvjj8

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a88d7d-784b755d79-qvjj8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-a88d7d-7d7f79555b-gkqr7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-a88d7d-7d7f79555b-gkqr7

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8

Started

Container started

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-a0083e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a0083e-openshift-default-5bb4897bcc from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

Unhealthy

Readiness probe failed: Get "http://10.132.1.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

ProbeError

Readiness probe error: Get "http://10.132.1.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

Unhealthy

Readiness probe failed: Get "http://10.132.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

ProbeError

Readiness probe error: Get "http://10.132.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-b-2d8df2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2d8df2-openshift-default-5b64664cd5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-2d8df2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-2d8df2

openshift-ingress

replicaset-controller

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5

SuccessfulCreate

Created pod: e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

openshift-ingress

multus

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

AddedInterface

Add eth0 [10.132.1.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-b-a0083e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a0083e-openshift-default-5bb4897bcc from 2 to 4
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm

AddedInterface

Add eth0 [10.132.1.62/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr

Unhealthy

Startup probe failed: Get "http://10.132.1.52:15021/healthz/ready": dial tcp 10.132.1.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr

ProbeError

Startup probe error: Get "http://10.132.1.52:15021/healthz/ready": dial tcp 10.132.1.52:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2d8df2-668896bb8b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-2d8df2-668896bb8b-wg5j8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-a88d7d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2d8df2-5978475675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2d8df2: serviceaccount "payload-processing-e2e-extmod-b-2d8df2" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-a88d7d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2d8df2-5978475675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-8pv7d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-2d8df2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-2d8df2-5978475675 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2d8df2-668896bb8b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-2d8df2-668896bb8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2d8df2: serviceaccount "payload-processing-e2e-extmod-b-2d8df2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-2d8df2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-2d8df2-668896bb8b from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

ProbeError

Startup probe error: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

Unhealthy

Startup probe failed: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

Unhealthy

Startup probe failed: Get "http://10.132.1.54:15021/healthz/ready": dial tcp 10.132.1.54:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-6d1778

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-6d1778
(x7)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

ProbeError

Startup probe error: Get "http://10.132.1.54:15021/healthz/ready": dial tcp 10.132.1.54:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-8pv7d

AddedInterface

Add eth0 [10.132.1.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-8pv7d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d8df2-668896bb8b-wg5j8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-8pv7d

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c

SuccessfulCreate

Created pod: e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

openshift-ingress

deployment-controller

e2e-extmod-b-6d1778-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-6d1778-openshift-default-5fccc76b5c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-8pv7d

Started

Container started

openshift-ingress

multus

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-2d8df2-668896bb8b-wg5j8

AddedInterface

Add eth0 [10.132.1.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d8df2-668896bb8b-wg5j8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm

Unhealthy

Startup probe failed: Get "http://10.132.1.62:15021/healthz/ready": dial tcp 10.132.1.62:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm

ProbeError

Startup probe error: Get "http://10.132.1.62:15021/healthz/ready": dial tcp 10.132.1.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d8df2-668896bb8b-wg5j8

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

ProbeError

Startup probe error: Get "http://10.132.1.55:15021/healthz/ready": dial tcp 10.132.1.55:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

Unhealthy

Startup probe failed: Get "http://10.132.1.55:15021/healthz/ready": dial tcp 10.132.1.55:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d8df2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d8df2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-6d1778

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-6d1778-649f5db87b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-6d1778

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-6d1778-788b49b675 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6d1778-649f5db87b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-6d1778-649f5db87b-kqr6w

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-84mwr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6d1778-649f5db87b-kqr6w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6d1778-649f5db87b-kqr6w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6d1778-649f5db87b-kqr6w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6d1778-788b49b675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6d1778: serviceaccount "payload-processing-e2e-extmod-b-6d1778" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-84mwr

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6d1778-788b49b675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-84mwr

openshift-ingress

multus

payload-processing-e2e-extmod-b-6d1778-649f5db87b-kqr6w

AddedInterface

Add eth0 [10.132.1.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-84mwr

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6d1778-649f5db87b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-6d1778-649f5db87b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6d1778: serviceaccount "payload-processing-e2e-extmod-b-6d1778" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-84mwr

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f0145f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f0145f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-b-a0083e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a0083e-openshift-default-5bb4897bcc from 4 to 8

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

AddedInterface

Add eth0 [10.132.1.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq

AddedInterface

Add eth0 [10.132.1.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

Unhealthy

Startup probe failed: Get "http://10.132.1.68:15021/healthz/ready": dial tcp 10.132.1.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

ProbeError

Startup probe error: Get "http://10.132.1.68:15021/healthz/ready": dial tcp 10.132.1.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq

ProbeError

Startup probe error: Get "http://10.132.1.69:15021/healthz/ready": dial tcp 10.132.1.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq

Unhealthy

Startup probe failed: Get "http://10.132.1.69:15021/healthz/ready": dial tcp 10.132.1.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6d1778-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6d1778-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

openshift-ingress

deployment-controller

e2e-extmod-b-a0083e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a0083e-openshift-default-5bb4897bcc from 8 to 10

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 4 to 8

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

AddedInterface

Add eth0 [10.132.1.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

Created

Container created

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

Unhealthy

Startup probe failed: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

ProbeError

Startup probe error: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

ProbeError

Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

Unhealthy

Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

ProbeError

Startup probe error: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

Unhealthy

Startup probe failed: Get "http://10.132.1.70:15021/healthz/ready": dial tcp 10.132.1.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulCreate

Created pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

AddedInterface

Add eth0 [10.132.1.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

Unhealthy

Readiness probe failed: Get "http://10.132.1.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

ProbeError

Readiness probe error: Get "http://10.132.1.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-a88d7d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-autores-a88d7d-openshift-default-5bf49799d7

SuccessfulCreate

Created pod: e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh

openshift-ingress

replicaset-controller

e2e-autores-a88d7d-openshift-default-5bf49799d7

SuccessfulCreate

Created pod: e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9

openshift-ingress

replicaset-controller

e2e-autores-a88d7d-openshift-default-5bf49799d7

SuccessfulCreate

Created pod: e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr

openshift-ingress

multus

e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-a88d7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-a88d7d-openshift-default-5bf49799d7 from 1 to 4

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9

Started

Container started

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh

Started

Container started

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr

Created

Container created

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr

Started

Container started

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9

Created

Container created

openshift-ingress

multus

e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr

AddedInterface

Add eth0 [10.132.1.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh

Created

Container created

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

ProbeError

Readiness probe error: Get "http://10.132.1.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

Unhealthy

Startup probe failed: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

ProbeError

Startup probe error: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

Unhealthy

Readiness probe failed: Get "http://10.132.1.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

ProbeError

Startup probe error: Get "http://10.132.1.71:15021/healthz/ready": dial tcp 10.132.1.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

Unhealthy

Startup probe failed: Get "http://10.132.1.71:15021/healthz/ready": dial tcp 10.132.1.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh

ProbeError

Startup probe error: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh

Unhealthy

Startup probe failed: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr

ProbeError

Startup probe error: Get "http://10.132.1.72:15021/healthz/ready": dial tcp 10.132.1.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr

Unhealthy

Startup probe failed: Get "http://10.132.1.72:15021/healthz/ready": dial tcp 10.132.1.72:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 1 to 4

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

Started

Container started

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

AddedInterface

Add eth0 [10.132.1.73/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

ProbeError

Readiness probe error: Get "http://10.132.1.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

Unhealthy

Readiness probe failed: Get "http://10.132.1.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

Unhealthy

Readiness probe failed: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

ProbeError

Readiness probe error: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

ProbeError

Startup probe error: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

Unhealthy

Startup probe failed: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

ProbeError

Startup probe error: Get "http://10.132.1.73:15021/healthz/ready": dial tcp 10.132.1.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

Unhealthy

Startup probe failed: Get "http://10.132.1.60:15021/healthz/ready": dial tcp 10.132.1.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

ProbeError

Startup probe error: Get "http://10.132.1.60:15021/healthz/ready": dial tcp 10.132.1.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

Unhealthy

Startup probe failed: Get "http://10.132.1.73:15021/healthz/ready": dial tcp 10.132.1.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

Unhealthy

Startup probe failed: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

ProbeError

Startup probe error: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

Unhealthy

Startup probe failed: Get "http://10.132.1.61:15021/healthz/ready": dial tcp 10.132.1.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

ProbeError

Startup probe error: Get "http://10.132.1.61:15021/healthz/ready": dial tcp 10.132.1.61:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-a88d7d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-a88d7d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

ProbeError

Readiness probe error: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

Unhealthy

Readiness probe failed: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulDelete

Deleted pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a88d7d-784b755d79-qvjj8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-4d2p8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-a88d7d-7d7f79555b-gkqr7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-autores-a88d7d-openshift-default-5bf49799d7

SuccessfulCreate

Created pod: e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-a88d7d-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

deployment-controller

e2e-autores-a88d7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-a88d7d-openshift-default-5bf49799d7 from 4 to 5
(x6)

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n

Started

Container started

openshift-ingress

multus

e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n

Created

Container created

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-fgvg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-qndm9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-67q6z

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d8df2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d8df2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

Created

Container created

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

AddedInterface

Add eth0 [10.132.1.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

Created

Container created

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 4 to 8

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

Unhealthy

Startup probe failed: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

ProbeError

Startup probe error: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

ProbeError

Startup probe error: Get "http://10.132.1.76:15021/healthz/ready": dial tcp 10.132.1.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

Unhealthy

Startup probe failed: Get "http://10.132.1.76:15021/healthz/ready": dial tcp 10.132.1.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

ProbeError

Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

Unhealthy

Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6d1778-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6d1778-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

multus

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

AddedInterface

Add eth0 [10.132.1.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 8 to 10

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96

Unhealthy

Startup probe failed: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96

ProbeError

Startup probe error: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

ProbeError

Startup probe error: Get "http://10.132.1.77:15021/healthz/ready": dial tcp 10.132.1.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

Unhealthy

Startup probe failed: Get "http://10.132.1.77:15021/healthz/ready": dial tcp 10.132.1.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-sqhdh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-nfw5n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-jlrk9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-qf9cr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-88acce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-88acce-openshift-default-6955f69bdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-88acce-openshift-default-6955f69bdf

SuccessfulCreate

Created pod: e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-a88d7d-openshift-default-5bf49799d7-cxhmj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-88acce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-88acce

openshift-ingress

multus

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

AddedInterface

Add eth0 [10.132.1.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-88acce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-88acce-696f848bc9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-88acce-545647888d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-88acce-545647888d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-88acce: serviceaccount "payload-processing-e2e-extmod-a-88acce" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-88acce-545647888d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-88acce-545647888d-gd22r

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-88acce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-88acce-545647888d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-88acce-696f848bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-88acce: serviceaccount "payload-processing-e2e-extmod-a-88acce" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-88acce-696f848bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-qxfgm

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88acce-545647888d-gd22r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-88acce-545647888d-gd22r

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88acce-545647888d-gd22r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88acce-545647888d-gd22r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-qxfgm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-qxfgm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-qxfgm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-qxfgm

AddedInterface

Add eth0 [10.132.1.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-2d8df2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2d8df2-openshift-default-5b64664cd5 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d8df2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5

SuccessfulCreate

Created pod: e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

openshift-ingress

multus

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-69f585c47c from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-69f585c47c

FailedCreate

Error creating: pods "payload-processing-external-model-69f585c47c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found
(x5)

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-69f585c47c-wkp5h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-69f585c47c

SuccessfulCreate

Created pod: payload-processing-external-model-69f585c47c-wkp5h

models-as-a-service

multus

payload-processing-external-model-69f585c47c-wkp5h

AddedInterface

Add eth0 [10.132.1.88/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-69f585c47c-wkp5h

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-69f585c47c-wkp5h

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-c44730-openshift-default-7b494bd597

SuccessfulCreate

Created pod: e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

openshift-ingress

deployment-controller

e2e-extmod-b-c44730-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-c44730-openshift-default-7b494bd597 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-c44730

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-c44730

openshift-ingress

multus

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

AddedInterface

Add eth0 [10.132.1.89/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-c44730-7cb74987b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-c44730-7cb74987b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-c44730: serviceaccount "payload-processing-e2e-extmod-b-c44730" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-c44730-7cb74987b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-c44730-7cb74987b-2q97s

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-c44730

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-c44730-7cb74987b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-c44730-57d47f9459

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-c44730: serviceaccount "payload-processing-e2e-extmod-b-c44730" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-c44730-57d47f9459

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-m68pb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-c44730

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-c44730-57d47f9459 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-m68pb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-m68pb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c44730-7cb74987b-2q97s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c44730-7cb74987b-2q97s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c44730-7cb74987b-2q97s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-c44730-7cb74987b-2q97s

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-m68pb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-m68pb

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

ProbeError

Startup probe error: Get "http://10.132.1.80:15021/healthz/ready": dial tcp 10.132.1.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

Unhealthy

Startup probe failed: Get "http://10.132.1.80:15021/healthz/ready": dial tcp 10.132.1.80:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-88acce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-88acce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5nt9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-s6zsz

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-5nt9s

AddedInterface

Add eth0 [10.132.1.94/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5nt9s

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-5nt9s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-s6zsz

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5nt9s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-s6zsz

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-s6zsz

AddedInterface

Add eth0 [10.132.1.95/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-s6zsz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-88acce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-88acce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5nt9s

Unhealthy

Startup probe failed: Get "http://10.132.1.94:15021/healthz/ready": dial tcp 10.132.1.94:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5nt9s

ProbeError

Startup probe error: Get "http://10.132.1.94:15021/healthz/ready": dial tcp 10.132.1.94:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-s6zsz

Unhealthy

Startup probe failed: Get "http://10.132.1.95:15021/healthz/ready": dial tcp 10.132.1.95:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-s6zsz

ProbeError

Startup probe error: Get "http://10.132.1.95:15021/healthz/ready": dial tcp 10.132.1.95:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 10 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulDelete

Deleted pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulDelete

Deleted pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-j4hgg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulDelete

Deleted pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-b4vn9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-fkvcl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-249sg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-s6zsz

Unhealthy

Startup probe failed: Get "http://10.132.1.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-extmod-b-a0083e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-a0083e-openshift-default-5bb4897bcc from 10 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5nt9s

Unhealthy

Startup probe failed: Get "http://10.132.1.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5nt9s

ProbeError

Startup probe error: Get "http://10.132.1.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-s6zsz

ProbeError

Startup probe error: Get "http://10.132.1.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-7kz9s

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-7kz9s

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7kz9s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-7t4cd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7kz9s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.049s (3.049s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7kz9s

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7kz9s

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-b9r4c

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7kz9s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7kz9s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

Unhealthy

Startup probe failed: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

ProbeError

Startup probe error: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused body:

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-4gvmg

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4gvmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-4gvmg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4gvmg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4gvmg

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-58ms2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-4mblp

Killing

Stopping container istio-proxy
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4gvmg

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4gvmg

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

ProbeError

Readiness probe error: Get "http://10.132.1.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

Unhealthy

Readiness probe failed: Get "http://10.132.1.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c44730-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c44730-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

Unhealthy

Startup probe failed: Get "http://10.132.1.89:15021/healthz/ready": dial tcp 10.132.1.89:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

ProbeError

Startup probe error: Get "http://10.132.1.89:15021/healthz/ready": dial tcp 10.132.1.89:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 10 to 8

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6hzf5

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-9dmkv

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c44730-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c44730-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w1-fa5a69-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-z4n95

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-fa5a69-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-54cb654cf from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-54cb654cf

SuccessfulCreate

Created pod: payload-processing-external-model-54cb654cf-98j9x

models-as-a-service

kubelet

payload-processing-external-model-54cb654cf-98j9x

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-54cb654cf-98j9x

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-54cb654cf-98j9x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-54cb654cf-98j9x

AddedInterface

Add eth0 [10.132.1.105/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-69f585c47c-wkp5h

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-69f585c47c

SuccessfulDelete

Deleted pod: payload-processing-external-model-69f585c47c-wkp5h

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-69f585c47c from 1 to 0

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 8 to 7

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-vbs65

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

models-as-a-service

replicaset-controller

payload-processing-external-model-5b5448f9b9

SuccessfulCreate

Created pod: payload-processing-external-model-5b5448f9b9-k56kd

models-as-a-service

kubelet

payload-processing-external-model-5b5448f9b9-k56kd

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5b5448f9b9-k56kd

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5b5448f9b9-k56kd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5b5448f9b9-k56kd

AddedInterface

Add eth0 [10.132.1.108/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-6969648bc7

SuccessfulCreate

Created pod: payload-processing-external-model-6969648bc7-2r5xt

models-as-a-service

replicaset-controller

payload-processing-external-model-5b5448f9b9

SuccessfulDelete

Deleted pod: payload-processing-external-model-5b5448f9b9-k56kd

models-as-a-service

kubelet

payload-processing-external-model-5b5448f9b9-k56kd

Killing

Stopping container payload-processing

models-as-a-service

multus

payload-processing-external-model-6969648bc7-2r5xt

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6969648bc7-2r5xt

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6969648bc7-2r5xt

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6969648bc7-2r5xt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5b5448f9b9-hx69p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6969648bc7-2r5xt

Killing

Stopping container payload-processing

models-as-a-service

multus

payload-processing-external-model-5b5448f9b9-hx69p

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5b5448f9b9 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5b5448f9b9-hx69p

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5b5448f9b9-hx69p

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-6969648bc7

SuccessfulDelete

Deleted pod: payload-processing-external-model-6969648bc7-2r5xt

models-as-a-service

replicaset-controller

payload-processing-external-model-5b5448f9b9

SuccessfulCreate

Created pod: payload-processing-external-model-5b5448f9b9-hx69p

models-as-a-service

kubelet

payload-processing-external-model-6969648bc7-mwfbf

Created

Container created
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5b5448f9b9 from 1 to 0
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6969648bc7 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-6969648bc7-mwfbf

AddedInterface

Add eth0 [10.132.1.109/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6969648bc7-mwfbf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5b5448f9b9-hx69p

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-5b5448f9b9

SuccessfulDelete

Deleted pod: payload-processing-external-model-5b5448f9b9-hx69p

models-as-a-service

kubelet

payload-processing-external-model-6969648bc7-mwfbf

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-6969648bc7

SuccessfulCreate

Created pod: payload-processing-external-model-6969648bc7-mwfbf

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5cd7f677db from 0 to 1
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6969648bc7 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-6969648bc7

SuccessfulDelete

Deleted pod: payload-processing-external-model-6969648bc7-mwfbf

models-as-a-service

replicaset-controller

payload-processing-external-model-5cd7f677db

SuccessfulCreate

Created pod: payload-processing-external-model-5cd7f677db-sqssr

models-as-a-service

kubelet

payload-processing-external-model-6969648bc7-mwfbf

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-5cd7f677db-sqssr

Started

Container started

models-as-a-service

multus

payload-processing-external-model-5cd7f677db-sqssr

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5cd7f677db-sqssr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5cd7f677db-sqssr

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-5cd7f677db

SuccessfulDelete

Deleted pod: payload-processing-external-model-5cd7f677db-sqssr

models-as-a-service

replicaset-controller

payload-processing-external-model-58946db44c

SuccessfulCreate

Created pod: payload-processing-external-model-58946db44c-tdkhz

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5cd7f677db from 1 to 0

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-qtzdf

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-4fh4p

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-fmjhk
(x6)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 7 to 10
(x6)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-qtzdf

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-qtzdf

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5cd7f677db-sqssr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-fmjhk

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-58946db44c-tdkhz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-fmjhk

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

AddedInterface

Add eth0 [10.132.1.111/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-fmjhk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-fmjhk

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-qtzdf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-58946db44c-tdkhz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-qtzdf

Started

Container started

models-as-a-service

multus

payload-processing-external-model-58946db44c-tdkhz

AddedInterface

Add eth0 [10.132.1.110/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-58946db44c-tdkhz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

models-as-a-service

kubelet

payload-processing-external-model-5cd7f677db-sqssr

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-b5bb1149aea2" not found
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-qtzdf

Unhealthy

Startup probe failed: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-qtzdf

ProbeError

Startup probe error: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-fmjhk

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-fmjhk

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

Unhealthy

Startup probe failed: Get "http://10.132.1.111:15021/healthz/ready": dial tcp 10.132.1.111:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

ProbeError

Startup probe error: Get "http://10.132.1.111:15021/healthz/ready": dial tcp 10.132.1.111:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

Unhealthy

Startup probe failed: Get "http://10.132.1.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

ProbeError

Startup probe error: Get "http://10.132.1.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

replicaset-controller

payload-processing-external-model-54cb654cf

SuccessfulDelete

Deleted pod: payload-processing-external-model-54cb654cf-98j9x

models-as-a-service

kubelet

payload-processing-external-model-54cb654cf-98j9x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

ProbeError

Readiness probe error: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Unhealthy

Readiness probe failed: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6nb96
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 9 to 8

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cfg5k

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 8 to 6

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-ddc2l

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-s22zm
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": context deadline exceeded
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-t8p9s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulDelete

Deleted pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-mgx58

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-kkz92

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulDelete

Deleted pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-82g8c

openshift-ingress

deployment-controller

e2e-extmod-b-a0083e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-a0083e-openshift-default-5bb4897bcc from 7 to 5

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-f8nz6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

models-as-a-service

replicaset-controller

payload-processing-external-model-65dff8f9bc

SuccessfulCreate

Created pod: payload-processing-external-model-65dff8f9bc-kxmrj

models-as-a-service

kubelet

payload-processing-external-model-65dff8f9bc-kxmrj

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-65dff8f9bc-kxmrj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-65dff8f9bc-kxmrj

AddedInterface

Add eth0 [10.132.1.114/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-65dff8f9bc-kxmrj

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-58946db44c

SuccessfulDelete

Deleted pod: payload-processing-external-model-58946db44c-tdkhz

models-as-a-service

kubelet

payload-processing-external-model-58946db44c-tdkhz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

Unhealthy

Readiness probe failed: Get "http://10.134.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

ProbeError

Readiness probe error: Get "http://10.134.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

ProbeError

Readiness probe error: Get "http://10.133.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

Unhealthy

Readiness probe failed: Get "http://10.133.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1c148a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1c148a

openshift-ingress

deployment-controller

e2e-inf-a-1c148a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1c148a-openshift-default-6b558c7dd7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-1c148a-openshift-default-6b558c7dd7

SuccessfulCreate

Created pod: e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

openshift-ingress

multus

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1c148a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1c148a-69b6466f68 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1c148a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1c148a: serviceaccount "payload-processing-e2e-inf-a-1c148a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1c148a-69b6466f68

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1c148a-69b6466f68-4557l
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1c148a-69b6466f68

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1c148a-69b6466f68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1c148a: serviceaccount "payload-processing-e2e-inf-a-1c148a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-jkzsb

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-jkzsb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-jkzsb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-jkzsb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-jkzsb

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-1c148a-69b6466f68-4557l

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1c148a-69b6466f68-4557l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1c148a-69b6466f68-4557l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1c148a-69b6466f68-4557l

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

ProbeError

Readiness probe error: Get "http://10.133.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

Unhealthy

Readiness probe failed: Get "http://10.133.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

Unhealthy

Startup probe failed: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

ProbeError

Startup probe error: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1c148a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1c148a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-inf-b-b66aad-openshift-default-5cfcc749d9

SuccessfulCreate

Created pod: e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

openshift-ingress

gateway_labeler_controller

e2e-inf-b-b66aad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b66aad

openshift-ingress

deployment-controller

e2e-inf-b-b66aad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b66aad-openshift-default-5cfcc749d9 from 0 to 1

openshift-ingress

multus

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

AddedInterface

Add eth0 [10.132.1.138/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b66aad: serviceaccount "payload-processing-e2e-inf-b-b66aad" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b66aad-6b96d78f98

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-b66aad-6b96d78f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b66aad: serviceaccount "payload-processing-e2e-inf-b-b66aad" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-b66aad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-mh9zb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-b66aad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-b66aad-6b96d78f98 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b66aad-6b96d78f98

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-b66aad-6b96d78f98-zlkbj

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b66aad-6b96d78f98-zlkbj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-mh9zb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-mh9zb

AddedInterface

Add eth0 [10.132.1.139/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-b66aad-6b96d78f98-zlkbj

AddedInterface

Add eth0 [10.132.1.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-mh9zb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b66aad-6b96d78f98-zlkbj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b66aad-6b96d78f98-zlkbj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-mh9zb

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1c148a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1c148a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

models-as-a-service

replicaset-controller

payload-processing-external-model-578778c84f

SuccessfulCreate

Created pod: payload-processing-external-model-578778c84f-dvrdh

models-as-a-service

kubelet

payload-processing-external-model-578778c84f-dvrdh

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-578778c84f-dvrdh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-578778c84f-dvrdh

AddedInterface

Add eth0 [10.132.1.141/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-578778c84f-dvrdh

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-86546bfd69

SuccessfulCreate

Created pod: payload-processing-external-model-86546bfd69-st8c4

models-as-a-service

replicaset-controller

payload-processing-external-model-578778c84f

SuccessfulDelete

Deleted pod: payload-processing-external-model-578778c84f-dvrdh

models-as-a-service

kubelet

payload-processing-external-model-86546bfd69-st8c4

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-578778c84f-dvrdh

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-86546bfd69-st8c4

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-86546bfd69-st8c4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-86546bfd69-st8c4

AddedInterface

Add eth0 [10.132.1.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulDelete

Deleted pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

models-as-a-service

replicaset-controller

payload-processing-external-model-86546bfd69

SuccessfulDelete

Deleted pod: payload-processing-external-model-86546bfd69-st8c4

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulDelete

Deleted pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 3 to 2

models-as-a-service

kubelet

payload-processing-external-model-86546bfd69-st8c4

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-578778c84f

SuccessfulCreate

Created pod: payload-processing-external-model-578778c84f-d5q7w
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-cx5nq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-5gcmd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

models-as-a-service

kubelet

payload-processing-external-model-578778c84f-d5q7w

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-578778c84f-d5q7w

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-578778c84f-d5q7w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-578778c84f-d5q7w

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-62efb8-openshift-default-848d569b9

SuccessfulCreate

Created pod: e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-62efb8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-62efb8

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8jslm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-inf-a-62efb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-62efb8-openshift-default-848d569b9 from 0 to 1

openshift-ingress

multus

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

AddedInterface

Add eth0 [10.132.1.144/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-62efb8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-62efb8-5957d6896c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-62efb8-74d8fbfd66

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-62efb8-74d8fbfd66-2gbn2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-62efb8-5957d6896c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-62efb8: serviceaccount "payload-processing-e2e-inf-a-62efb8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-62efb8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-62efb8-74d8fbfd66 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-62efb8-74d8fbfd66

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-62efb8-74d8fbfd66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-62efb8: serviceaccount "payload-processing-e2e-inf-a-62efb8" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-dvknf

AddedInterface

Add eth0 [10.132.1.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-dvknf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b66aad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-dvknf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-dvknf

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-62efb8-5957d6896c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-dvknf

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b66aad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-inf-a-62efb8-74d8fbfd66-2gbn2

AddedInterface

Add eth0 [10.132.1.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-62efb8-74d8fbfd66-2gbn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-62efb8-74d8fbfd66-2gbn2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-62efb8-74d8fbfd66-2gbn2

Started

Container started
(x6)

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-hg766

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x8)

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2d8df2-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

models-as-a-service

kubelet

payload-processing-external-model-65dff8f9bc-kxmrj

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-extmod-b-2d8df2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-2d8df2-openshift-default-5b64664cd5 from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5

SuccessfulDelete

Deleted pod: e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-tlqmd

Killing

Stopping container istio-proxy
(x10)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled down replica set payload-processing-external-model-65dff8f9bc from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-65dff8f9bc

SuccessfulDelete

Deleted pod: payload-processing-external-model-65dff8f9bc-kxmrj

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 6 to 3

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-5dtg8

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cn5xn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulDelete

Deleted pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-xcbkx

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-fhhtg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 5 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulDelete

Deleted pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

openshift-ingress

replicaset-controller

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc

SuccessfulDelete

Deleted pod: e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

openshift-ingress

deployment-controller

e2e-extmod-b-a0083e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-a0083e-openshift-default-5bb4897bcc from 5 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-tb7w4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a0083e-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7kz9s

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-7kz9s

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a519e9-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

Unhealthy

Readiness probe failed: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-a519e9-openshift-default-b7b85d565

SuccessfulDelete

Deleted pod: e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

ProbeError

Readiness probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-g4mrj

Unhealthy

Readiness probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-a519e9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a519e9-openshift-default-b7b85d565 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-sb7zr

ProbeError

Readiness probe error: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

Unhealthy

Readiness probe failed: Get "http://10.134.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-ddhg9

ProbeError

Readiness probe error: Get "http://10.134.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

Unhealthy

Readiness probe failed: Get "http://10.134.0.187:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-6gz6r

ProbeError

Readiness probe error: Get "http://10.134.0.187:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-pml6c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-b22a13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-b22a13-openshift-default-c6f496b49 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-b22a13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-b22a13

openshift-ingress

replicaset-controller

e2e-inf-a-b22a13-openshift-default-c6f496b49

SuccessfulCreate

Created pod: e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv

AddedInterface

Add eth0 [10.132.1.148/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

ProbeError

Readiness probe error: Get "http://10.132.1.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

Unhealthy

Readiness probe failed: Get "http://10.132.1.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-47skp

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

Unhealthy

Readiness probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-pmx7t

ProbeError

Readiness probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b22a13-59d6b5f474

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-b22a13-59d6b5f474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b22a13: serviceaccount "payload-processing-e2e-inf-a-b22a13" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-b22a13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-b22a13-59df5589d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b22a13-59df5589d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-7xtps
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b22a13-59df5589d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b22a13: serviceaccount "payload-processing-e2e-inf-a-b22a13" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b22a13-59d6b5f474

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-b22a13-59d6b5f474-sxgb4

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-b22a13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-b22a13-59d6b5f474 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-7xtps

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b22a13-59d6b5f474-sxgb4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-7xtps

AddedInterface

Add eth0 [10.132.1.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-7xtps

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-b22a13-59d6b5f474-sxgb4

AddedInterface

Add eth0 [10.132.1.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b22a13-59d6b5f474-sxgb4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b22a13-59d6b5f474-sxgb4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-7xtps

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-578778c84f-d5q7w

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

Started

Container started

openshift-ingress

deployment-controller

e2e-inf-a-8baf7e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-8baf7e-openshift-default-78bb4856df from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-8baf7e-openshift-default-78bb4856df

SuccessfulCreate

Created pod: e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6

openshift-ingress

gateway_labeler_controller

e2e-inf-a-8baf7e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-8baf7e
(x5)

openshift-ingress

kubelet

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

ProbeError

Startup probe error: Get "http://10.132.1.138:15021/healthz/ready": dial tcp 10.132.1.138:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6

AddedInterface

Add eth0 [10.132.1.156/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

Unhealthy

Startup probe failed: Get "http://10.132.1.138:15021/healthz/ready": dial tcp 10.132.1.138:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-8baf7e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-8baf7e-9ff764875 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-8baf7e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-8baf7e-5b76fb7786 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8baf7e-5b76fb7786

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-8baf7e-5b76fb7786-mb5vr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8baf7e-5b76fb7786

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-8baf7e-5b76fb7786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8baf7e: serviceaccount "payload-processing-e2e-inf-a-8baf7e" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8baf7e-9ff764875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8baf7e: serviceaccount "payload-processing-e2e-inf-a-8baf7e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8baf7e-9ff764875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-7dprb

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-7dprb

AddedInterface

Add eth0 [10.132.1.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-7dprb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-8baf7e-5b76fb7786-mb5vr

AddedInterface

Add eth0 [10.132.1.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-7dprb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-7dprb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8baf7e-5b76fb7786-mb5vr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8baf7e-5b76fb7786-mb5vr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8baf7e-5b76fb7786-mb5vr

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b66aad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b66aad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-62efb8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-62efb8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

ProbeError

Startup probe error: Get "http://10.132.1.144:15021/healthz/ready": dial tcp 10.132.1.144:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

Unhealthy

Startup probe failed: Get "http://10.132.1.144:15021/healthz/ready": dial tcp 10.132.1.144:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-89f101-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-89f101-openshift-default-5fdc59467f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-89f101

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-89f101

openshift-ingress

replicaset-controller

e2e-inf-b-89f101-openshift-default-5fdc59467f

SuccessfulCreate

Created pod: e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z

openshift-ingress

multus

e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z

AddedInterface

Add eth0 [10.132.1.159/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-89f101

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-89f101-786b784bfb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-89f101-786b784bfb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-89f101-786b784bfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-89f101: serviceaccount "payload-processing-e2e-inf-b-89f101" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-89f101-d7dd45c55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-89f101: serviceaccount "payload-processing-e2e-inf-b-89f101" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-89f101-d7dd45c55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-mkdnv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-89f101

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-89f101-d7dd45c55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-89f101-786b784bfb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-89f101-786b784bfb-sppfr

openshift-ingress

multus

payload-processing-e2e-inf-b-89f101-786b784bfb-sppfr

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-mkdnv

AddedInterface

Add eth0 [10.132.1.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-mkdnv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-89f101-786b784bfb-sppfr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-89f101-786b784bfb-sppfr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-mkdnv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-89f101-786b784bfb-sppfr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-mkdnv

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-62efb8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-62efb8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a5f459

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a5f459

openshift-ingress

deployment-controller

e2e-inf-b-a5f459-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a5f459-openshift-default-66968fd697 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-a5f459-openshift-default-66968fd697

SuccessfulCreate

Created pod: e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

openshift-ingress

multus

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

AddedInterface

Add eth0 [10.132.1.161/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a5f459-77df44f7fd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a5f459-77df44f7fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a5f459: serviceaccount "payload-processing-e2e-inf-b-a5f459" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a5f459

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a5f459-77df44f7fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a5f459-77df44f7fd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a5f459-77df44f7fd-zg4q2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a5f459: serviceaccount "payload-processing-e2e-inf-b-a5f459" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-9xqfx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a5f459

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-9xqfx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b22a13-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-9xqfx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a5f459-77df44f7fd-zg4q2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a5f459-77df44f7fd-zg4q2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-9xqfx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-9xqfx

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b22a13-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-inf-b-a5f459-77df44f7fd-zg4q2

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a5f459-77df44f7fd-zg4q2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv

Unhealthy

Startup probe failed: Get "http://10.132.1.148:15021/healthz/ready": dial tcp 10.132.1.148:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv

ProbeError

Startup probe error: Get "http://10.132.1.148:15021/healthz/ready": dial tcp 10.132.1.148:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6

Unhealthy

Startup probe failed: Get "http://10.132.1.156:15021/healthz/ready": dial tcp 10.132.1.156:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b22a13-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b22a13-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6

ProbeError

Startup probe error: Get "http://10.132.1.156:15021/healthz/ready": dial tcp 10.132.1.156:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-be48b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-be48b4

openshift-ingress

deployment-controller

e2e-inf-b-be48b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-be48b4-openshift-default-5879f5498c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-be48b4-openshift-default-5879f5498c

SuccessfulCreate

Created pod: e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

openshift-ingress

multus

e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

AddedInterface

Add eth0 [10.132.1.162/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-hfqfr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-be48b4: serviceaccount "payload-processing-e2e-inf-b-be48b4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-be48b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-be48b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-be48b4-6f5ccbbf64 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-be48b4-6f5ccbbf64

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-be48b4-6f5ccbbf64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-be48b4: serviceaccount "payload-processing-e2e-inf-b-be48b4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-be48b4-6f5ccbbf64

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-be48b4-6f5ccbbf64-9rmpp

openshift-ingress

kubelet

payload-processing-e2e-inf-b-be48b4-6f5ccbbf64-9rmpp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-be48b4-6f5ccbbf64-9rmpp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-hfqfr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-be48b4-6f5ccbbf64-9rmpp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-hfqfr

AddedInterface

Add eth0 [10.132.1.163/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-be48b4-6f5ccbbf64-9rmpp

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-hfqfr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-hfqfr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z

Unhealthy

Startup probe failed: Get "http://10.132.1.159:15021/healthz/ready": dial tcp 10.132.1.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z

ProbeError

Startup probe error: Get "http://10.132.1.159:15021/healthz/ready": dial tcp 10.132.1.159:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-89f101-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-89f101-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8baf7e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8baf7e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

ProbeError

Readiness probe error: Get "http://10.132.1.161:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

Unhealthy

Readiness probe failed: Get "http://10.132.1.161:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

Unhealthy

Startup probe failed: Get "http://10.132.1.161:15021/healthz/ready": dial tcp 10.132.1.161:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-89f101-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-89f101-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

ProbeError

Startup probe error: Get "http://10.132.1.161:15021/healthz/ready": dial tcp 10.132.1.161:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a5f459-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a5f459-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a5f459-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a5f459-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-jn9z2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2d2923-6d6d74576d-l294v

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2d2923-7f66c948d7-jn9z2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2d2923-6d6d74576d-l294v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-hbpn7

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-hbpn7

Created

Container created
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-hbpn7

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-hbpn7_4f0ff2d7-3e33-4621-a3ff-21347853a9cc

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-hbpn7_4f0ff2d7-3e33-4621-a3ff-21347853a9cc became leader

openshift-ingress

kubelet

e2e-extmod-a-2d2923-openshift-default-5b69647fb5-rk6m6

Killing

Stopping container istio-proxy

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-bwccj

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-bwccj

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-bwccj

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-bwccj

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-bwccj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.186s (5.186s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-bwccj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a0083e-d588694d8-kzrwp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-tv9f9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-jkzsb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1c148a-69b6466f68-4557l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-bqpx8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-a0083e-openshift-default-5bb4897bcc-rcpwq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a0083e-d588694d8-kzrwp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a0083e-7688448cbc-tv9f9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 3 to 2

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-qvpf6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

BackOff

Back-off restarting failed container istio-proxy in pod e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p_openshift-ingress(cd760fe2-e8c7-42f9-8a3f-40ec810159b4)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-be48b4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-be48b4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-eaee88-544ddb87d6-cckhd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-eaee88-688ff65ddc-zq8v9

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

kubelet

e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1c148a-69b6466f68-4557l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

kubelet

e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

kubelet

e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1c148a-5d48d58c47-jkzsb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

deployment-controller

e2e-worker-w3-8d6349-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8d6349-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target
(x7)

openshift-ingress

replicaset-controller

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-h4jmc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69f3fa-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-69f3fa-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-extmod-b-69f3fa-openshift-default-6cb89794d5 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf
(x5)

openshift-ingress

kubelet

e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

Unhealthy

Startup probe failed: Get "http://10.132.1.162:15021/healthz/ready": dial tcp 10.132.1.162:15021: connect: connection refused
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-eaee88-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-eaee88-openshift-default-5b98dc9889 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-eaee88-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-eaee88-openshift-default-5b98dc9889

SuccessfulCreate

Created pod: e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx
(x5)

openshift-ingress

kubelet

e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

ProbeError

Startup probe error: Get "http://10.132.1.162:15021/healthz/ready": dial tcp 10.132.1.162:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-8d44dd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5

SuccessfulDelete

Deleted pod: e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-8d44dd-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-dx7vf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-t5kbg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-1c148a-openshift-default-6b558c7dd7-rh2fr

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b66aad-6b96d78f98-zlkbj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-mh9zb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4gvmg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-7t4cd
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-7t4cd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-4fh4p

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 10 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-fmjhk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-5mhqr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-4gvmg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-4fh4p

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-fmjhk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5mhqr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x8)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-be48b4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x8)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-be48b4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b66aad-6b96d78f98-zlkbj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b66aad-7994fbc7cf-mh9zb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-inf-a-b22a13-openshift-default-c6f496b49

SuccessfulCreate

Created pod: e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch

Created

Container created

openshift-ingress

deployment-controller

e2e-inf-a-b22a13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-b22a13-openshift-default-c6f496b49 from 1 to 2

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b22a13-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch

ProbeError

Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch

Unhealthy

Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-5zmvx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-eaee88-openshift-default-5b98dc9889-8q4mq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-b66aad-openshift-default-5cfcc749d9-tdh9v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88acce-545647888d-gd22r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-qxfgm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88acce-696f848bc9-qxfgm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88acce-545647888d-gd22r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-88acce-openshift-default-6955f69bdf-bzkzq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c44730-7cb74987b-2q97s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-m68pb

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c44730-7cb74987b-2q97s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c44730-57d47f9459-m68pb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-c44730-openshift-default-7b494bd597-xd4sm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-47czd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-7xtps

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b22a13-59d6b5f474-sxgb4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-48kw6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w0-4f3973-openshift-default-559bc8bf6c-zkbzc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b22a13-59df5589d7-7xtps

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-4f3973-768c84dbc-48kw6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-kgnch

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-4f3973-76bb9cf8b8-47czd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-b22a13-openshift-default-c6f496b49-z6dnv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-aaf467-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-aaf467-openshift-default-7f46d488c5 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-aaf467-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-aaf467-openshift-default-7f46d488c5

SuccessfulDelete

Deleted pod: e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-zzkq6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-ad1661-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-extmod-a-ad1661-openshift-default-7fdc5689d9 from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ad1661-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-9lzbh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-w8ll9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-dvknf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-62efb8-74d8fbfd66-2gbn2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-7dprb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8baf7e-5b76fb7786-mb5vr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-9xqfx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-x8tzt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a5f459-77df44f7fd-zg4q2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w0-b9ff93-openshift-default-7fb7b8684c-jmrz9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-62efb8-74d8fbfd66-2gbn2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-62efb8-5957d6896c-dvknf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b9ff93-d89cd44bc-9lzbh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b9ff93-5b695fd5c6-w8ll9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-62efb8-openshift-default-848d569b9-f7dwx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a519e9-7b75656447-pgbsg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a519e9-8c464697d-gpjt7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-89f101-786b784bfb-sppfr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-mkdnv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a5f459-fc97c8bf9-9xqfx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8baf7e-9ff764875-7dprb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-8baf7e-openshift-default-78bb4856df-z8sn6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-a5f459-openshift-default-66968fd697-b22xd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-89f101-786b784bfb-sppfr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-89f101-d7dd45c55-mkdnv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-be48b4-6f5ccbbf64-9rmpp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-hfqfr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ad1661-7949885446-5w8j8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ad1661-76fd7cf99-k9dns

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-89f101-openshift-default-5fdc59467f-75g5z

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-be48b4-fdf6dd687-hfqfr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-zc52v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-ncd8b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-be48b4-openshift-default-5879f5498c-56q9p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a519e9-openshift-default-b7b85d565-dzrnk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ad1661-openshift-default-7fdc5689d9-cpw7g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-f5g5p

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-f5g5p

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6d1778-649f5db87b-kqr6w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-84mwr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-mp68x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f0145f-78879f4dd-8cbb4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-b8ca49-7d87ddcdb6-ncd8b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-b8ca49-6bf6ffdcc9-zc52v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-b8ca49-openshift-default-7d467d9545-njslk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-f0145f-openshift-default-6dc7d74d8f-6kgbr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-qtzdf

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 5 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-qtzdf

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-69f3fa-f7fbffb7-8cxxl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-69f3fa-584957b64d-7cdxt

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6d1778-788b49b675-84mwr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6d1778-649f5db87b-kqr6w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d8df2-668896bb8b-wg5j8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-8pv7d

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f0145f-65b548dbc-mp68x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f0145f-78879f4dd-8cbb4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-6d1778-openshift-default-5fccc76b5c-ztjmz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b9r4c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-8km4m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-d7bll

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-69f3fa-openshift-default-6cb89794d5-bnv5g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-2d8df2-openshift-default-5b64664cd5-2ktr2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2d8df2-668896bb8b-wg5j8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2d8df2-5978475675-8pv7d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-jq6b2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-b97d5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-98djx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-zhhc9

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6e2548-659965cc47-d7bll

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6e2548-6647c5c56-8km4m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-6e2548-openshift-default-86665b47c5-q785n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-645f2b-openshift-default-78db55bf75-msmtd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-645f2b-cd8c4b676-jq6b2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-645f2b-d56dddf5f-b97d5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-xj5b7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-sp6f7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-adcdcb-7b79b5cf47-zhhc9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-adcdcb-754787d6fb-98djx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-7g7mz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-n2wxw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-adcdcb-openshift-default-85679766c5-7zq26

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-30fbb6-openshift-default-df9656985-czkfx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-868b1f-openshift-default-85db5d8bc9-tjtn6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-vgdqq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-zpmgn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-aaf467-544d8fdc84-jjcv9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-v6pxh

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-30fbb6-65bd599cc9-n2wxw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-868b1f-fcffcf6bd-sp6f7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-868b1f-6856b9dbff-xj5b7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8d6349-6766f4df5b-kw5gt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-c7m7g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-30fbb6-649cfc46f8-7g7mz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-fa5a69-openshift-default-6548c4d875-rlppx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fa5a69-66fc6646dd-zpmgn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-8d44dd-f699bfc76-46t7w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-pfkgg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fa5a69-5884494dcf-vgdqq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-aaf467-b7485f4f5-v6pxh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-aaf467-544d8fdc84-jjcv9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8d6349-796776cf47-c7m7g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-8d6349-openshift-default-6b9c99ddb7-w7klr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8d6349-6766f4df5b-kw5gt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-aaf467-openshift-default-7f46d488c5-swkrx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-8d44dd-f699bfc76-46t7w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-8d44dd-5994685567-pfkgg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-8d44dd-openshift-default-7d6bc946f5-wqpnw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: