Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7-vxf9n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7-vxf9n to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5-6jkqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5-6jkqk to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk to ip-10-0-131-21.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-5w9v5

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-5w9v5 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575-mkpjp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575-mkpjp to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f-s7vvx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f-s7vvx to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc-kq9j4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc-kq9j4 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb to ip-10-0-131-21.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-s6zvf

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-s6zvf to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5 to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95-2fgh6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95-2fgh6 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795-mf9jg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795-mf9jg to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-5bk4p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-5bk4p to ip-10-0-131-21.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-gx9tg

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-gx9tg to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875-8jrmp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875-8jrmp to ip-10-0-131-21.ec2.internal

cert-manager

cert-manager-597b95cb84-q7c24

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-q7c24 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f-bmcdj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f-bmcdj to ip-10-0-136-156.ec2.internal

kuadrant-system

authorino-57f7f8659f-5nrtq

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-5nrtq to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7-98td5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7-98td5 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-s9xgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-s9xgp to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-s2tn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-s2tn2 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5c54fc-7467846795-qndhq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5c54fc-7467846795-qndhq to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-752623-85c7595ccf-jv2ls

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-752623-85c7595ccf-jv2ls to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9 to ip-10-0-136-157.ec2.internal

kuadrant-system

authorino-5c695f6bc5-nbdsf

Scheduled

Successfully assigned kuadrant-system/authorino-5c695f6bc5-nbdsf to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2 to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-8hf7s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-8hf7s to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-752623-b4dcbd679-27pb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-752623-b4dcbd679-27pb6 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-710927-5bdd596d55-2t8rq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-710927-5bdd596d55-2t8rq to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p to ip-10-0-131-21.ec2.internal

kuadrant-system

authorino-6889cbd8c4-6cv8p

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-6cv8p to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-v4qx7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-v4qx7 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z to ip-10-0-136-157.ec2.internal

kuadrant-system

authorino-6f6944bcdd-rgwv5

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-rgwv5 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff-6kxwd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff-6kxwd to ip-10-0-136-157.ec2.internal

kuadrant-system

authorino-8687975cdd-6l8tp

Scheduled

Successfully assigned kuadrant-system/authorino-8687975cdd-6l8tp to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-v5wpt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-v5wpt to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c-kcqqn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c-kcqqn to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48 to ip-10-0-136-156.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-l7tsw

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-l7tsw to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6 to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-c6hdt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-c6hdt to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c-ptvmb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c-ptvmb to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5-k9bj7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5-k9bj7 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-2jddx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-2jddx to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-j9ws8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-j9ws8 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867-7qlsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867-7qlsd to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-353db9f5-597d5d686c-xklsb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-353db9f5-597d5d686c-xklsb to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-q72sx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-q72sx to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6 to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7-mnbgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7-mnbgp to ip-10-0-131-21.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-774gh

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-774gh to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-448b01-67f46999c5-jlp47

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-448b01-67f46999c5-jlp47 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff-dg6gq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff-dg6gq to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-p4p27

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-p4p27 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-shkg8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-shkg8 to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-943963-688574d587-7wwhp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-943963-688574d587-7wwhp to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-pnrxl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-pnrxl to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-ld82r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-ld82r to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-w497b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-w497b to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-efdee4-bf759994c-8q9gs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-efdee4-bf759994c-8q9gs to ip-10-0-136-157.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-vpn5l

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-vpn5l to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff-cxl4d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff-cxl4d to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547-8vkdw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547-8vkdw to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-9c8b33-576597d459-mq54c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-9c8b33-576597d459-mq54c to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447-m9fhx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447-m9fhx to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c-8lc6x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c-8lc6x to ip-10-0-131-21.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-cxhcb

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-cxhcb to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc-jkc89

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc-jkc89 to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947-vkvqr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947-vkvqr to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-f1128d-575cff74f5-j7hbl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-f1128d-575cff74f5-j7hbl to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-98ngt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-98ngt to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-7prdg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-7prdg to ip-10-0-136-156.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-sh9g6

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-sh9g6 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-c9dzw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-c9dzw to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-q7drz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-q7drz to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-fp9xd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-fp9xd to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-29mnm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-29mnm to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-5lcg6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-5lcg6 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt to ip-10-0-136-156.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-8p5kz

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-8p5kz to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-qgl9q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-qgl9q to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-whppz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-whppz to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-gjj44

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-gjj44 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a3dae1-b68556cb7-nrmjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a3dae1-b68556cb7-nrmjs to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m to ip-10-0-136-157.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-ltl6h

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-ltl6h to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-43fb1b-5799d848d7-m7b45

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-43fb1b-5799d848d7-m7b45 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh to ip-10-0-131-21.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-d5mxp

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-d5mxp to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-55fbbbf9dc-hxh82

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-hxh82 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-ait-25447e22-5998f5c689-sxqzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-25447e22-5998f5c689-sxqzp to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9df039e4-84bfcd89ff-bkr7c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9df039e4-84bfcd89ff-bkr7c to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ac0736b6-dc9cbf5c9-xsqhm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ac0736b6-dc9cbf5c9-xsqhm to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-07afdd-7f68948dcf-kspdn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-07afdd-7f68948dcf-kspdn to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-371531-56c4759659-xfppb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-371531-56c4759659-xfppb to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk to ip-10-0-136-157.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-2trls

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2trls to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-248b29-56d94578bc-xhmmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-248b29-56d94578bc-xhmmn to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-08ddf0-5f75dbd4bc-hs796

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-08ddf0-5f75dbd4bc-hs796 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc-ltfg6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc-ltfg6 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-7ac3c8-76bc49454f-vfdpw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-7ac3c8-76bc49454f-vfdpw to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-90db52-57478fddb7-vq79w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-90db52-57478fddb7-vq79w to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x

Scheduled

Successfully assigned openshift-ingress/e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-mt-084d807f-openshift-default-84c8676869-zqhjh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-084d807f-openshift-default-84c8676869-zqhjh to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-mt-084d807f-openshift-default-84c8676869-9pvlc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-084d807f-openshift-default-84c8676869-9pvlc to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj to ip-10-0-131-21.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-bfqc5

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-bfqc5 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc-tdlt8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc-tdlt8 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-lpr6x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-lpr6x to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-07afdd-696875d767-mll88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-07afdd-696875d767-mll88 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ac0736b6-54b457b99-m5xt5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ac0736b6-54b457b99-m5xt5 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648 to ip-10-0-136-157.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-jkfxf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-jkfxf to ip-10-0-136-157.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-bnv8m

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-bnv8m to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z to ip-10-0-136-156.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-7dd27

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7dd27 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-248b29-7c8fd468f5-fm992

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-248b29-7c8fd468f5-fm992 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-371531-7b5cd97689-rtfrd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-371531-7b5cd97689-rtfrd to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-43fb1b-78b54d5df-9nst7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-43fb1b-78b54d5df-9nst7 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-a3dae1-ccf495dff-kl5cj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a3dae1-ccf495dff-kl5cj to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6 to ip-10-0-136-157.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-kb2gj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-kb2gj to ip-10-0-136-156.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-r4hv9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-r4hv9 to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-autores-f1128d-666bb85d4f-nstgl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-f1128d-666bb85d4f-nstgl to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7-gv4rc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7-gv4rc to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-efdee4-54d7b4cdff-2dr49

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-efdee4-54d7b4cdff-2dr49 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-4275b9-67997cc74f-twxgh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-4275b9-67997cc74f-twxgh to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-r978k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-r978k to ip-10-0-136-157.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-xcmm7

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-xcmm7 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-696f9a-67f544df69-gb7nm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-696f9a-67f544df69-gb7nm to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-943963-7568c9dd8c-99fk7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-943963-7568c9dd8c-99fk7 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-fac043-7f5bf697-vrxkn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-fac043-7f5bf697-vrxkn to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79-wjpd6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79-wjpd6 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-4a73b1-77b884cb9-g55qb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-4a73b1-77b884cb9-g55qb to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-56a6d4-6758676965-4l9dm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-56a6d4-6758676965-4l9dm to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-a5affe-86cc9766b5-278sw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-a5affe-86cc9766b5-278sw to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-bxss4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-bxss4 to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1b0cce-7996cb486f-vpwrv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1b0cce-7996cb486f-vpwrv to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-710927-7859f7d845-ht9pt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-710927-7859f7d845-ht9pt to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-cd421c-6884df5c6c-ns6q6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-cd421c-6884df5c6c-ns6q6 to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-5c54fc-5f9f868c59-s5bgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5c54fc-5f9f868c59-s5bgq to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c08360-58948b75c9-k66nk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c08360-58948b75c9-k66nk to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c2d1b8-79c64d499f-fd4zx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c2d1b8-79c64d499f-fd4zx to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-89d4a2-654f669f45-f4mvn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-89d4a2-654f669f45-f4mvn to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d-q8n2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d-q8n2h to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9df039e4-866c7df7b7-56zff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9df039e4-866c7df7b7-56zff to ip-10-0-136-157.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j9gvf

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j9gvf to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c40fc3-5dd57656d8-s2x4v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c40fc3-5dd57656d8-s2x4v to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff-tt9qf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff-tt9qf to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d43b66-64664b7648-xk474

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d43b66-64664b7648-xk474 to ip-10-0-131-21.ec2.internal

openshift-ingress

kube-auth-proxy-5587c8dd5c-gs8xq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5587c8dd5c-gs8xq to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d43b66-774fc575ff-zvlk8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d43b66-774fc575ff-zvlk8 to ip-10-0-131-21.ec2.internal

openshift-ingress

kube-auth-proxy-5587c8dd5c-htpqs

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5587c8dd5c-htpqs to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-fc0d65-5657d46c4f-ql4x5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fc0d65-5657d46c4f-ql4x5 to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-ppvzt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-ppvzt to ip-10-0-131-21.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-294zx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-294zx to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8 to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-09f39e-796d44785b-8w85c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-09f39e-796d44785b-8w85c to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-09f39e-ccff47f95-b9rsw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-09f39e-ccff47f95-b9rsw to ip-10-0-136-156.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-4gck9

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-4gck9 to ip-10-0-131-21.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-5drlf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-5drlf to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-752623-57547865cc-lzn4w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-752623-57547865cc-lzn4w to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-25447e22-569c6647cf-ql62d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-25447e22-569c6647cf-ql62d to ip-10-0-136-157.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-94gsm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-94gsm to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-752623-6bc5bf56b6-pm4z4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-752623-6bc5bf56b6-pm4z4 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd to ip-10-0-136-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-96tvd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-96tvd to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-9bbfc5-565fd984df-pmdxb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9bbfc5-565fd984df-pmdxb to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-f9sls

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-f9sls to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd-t85fc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd-t85fc to ip-10-0-136-157.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-b659t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-b659t to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d75c94-655fd7c9cb-4tcp8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d75c94-655fd7c9cb-4tcp8 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j to ip-10-0-136-156.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-856b6dffcf-vdw7b

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-856b6dffcf-vdw7b to ip-10-0-136-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-bncsq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-bncsq to ip-10-0-136-156.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-lq8t9

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lq8t9 to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d75c94-6c8845777f-jdvq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d75c94-6c8845777f-jdvq2 to ip-10-0-131-21.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-btqnt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-btqnt to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-353db9f5-69b57cffb7-6wt7s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-353db9f5-69b57cffb7-6wt7s to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-mt-084d807f-7648554b69-4gw5r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-084d807f-7648554b69-4gw5r to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-mt-084d807f-7648554b69-6k7t8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-084d807f-7648554b69-6k7t8 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc-654pk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc-654pk to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2 to ip-10-0-136-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-c7qkl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-c7qkl to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-448b01-6778f95d9-mjvcz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-448b01-6778f95d9-mjvcz to ip-10-0-136-157.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-cts4j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-cts4j to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-6d6576-7b97b7b6c-txn52

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-6d6576-7b97b7b6c-txn52 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg to ip-10-0-136-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-f9pgk to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-80542b-6c5b644b9-v8vqz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-80542b-6c5b644b9-v8vqz to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf to ip-10-0-136-157.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p to ip-10-0-136-157.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-gjgbb to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-b01ff6-7688d65785-bgzkr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-b01ff6-7688d65785-bgzkr to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-1f523a-867bb8df5c-szvlr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-1f523a-867bb8df5c-szvlr to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-9c8b33-59cdb566d5-n8frp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-9c8b33-59cdb566d5-n8frp to ip-10-0-131-21.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-gmgjs to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-ad121b-5c8c48fb87-m6zjl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ad121b-5c8c48fb87-m6zjl to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-bb9990-644f4468f9-tvk5r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-bb9990-644f4468f9-tvk5r to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-f4569e-d74dfcc47-qk226

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f4569e-d74dfcc47-qk226 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8 to ip-10-0-136-157.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-hcd5s to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-8t5wq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-8t5wq to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-v2lgh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-v2lgh to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-j78zf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-j78zf to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-5fw8n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-5fw8n to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-l6tzn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-l6tzn to ip-10-0-136-157.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-p874b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-p874b to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-n7kw6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-n7kw6 to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-4b5989-94b469d6f-qd76b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-4b5989-94b469d6f-qd76b to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp to ip-10-0-136-157.ec2.internal

models-as-a-service

payload-processing-external-model-54fc546546-rdlkm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-54fc546546-rdlkm to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q

Scheduled

Successfully assigned openshift-ingress/e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-994336-776fb75b4f-628xt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-994336-776fb75b4f-628xt to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-c16684-685b865b6c-qbtqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-c16684-685b865b6c-qbtqr to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

Scheduled

Successfully assigned openshift-ingress/e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc to ip-10-0-136-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-kf6vz to ip-10-0-136-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vxrb9 to ip-10-0-131-21.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vnvpp to ip-10-0-136-157.ec2.internal

models-as-a-service

payload-processing-external-model-58cdbd54fd-wbdtq

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-58cdbd54fd-wbdtq to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-api-b-371531-openshift-default-d977d868c-nzsxr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-371531-openshift-default-d977d868c-nzsxr to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-api-b-248b29-openshift-default-66f64586d5-94rjj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-248b29-openshift-default-66f64586d5-94rjj to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-90db52-openshift-default-f788579b9-xp2jz to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z to ip-10-0-136-157.ec2.internal

models-as-a-service

payload-processing-external-model-5fb7f7d54b-fkfs7

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5fb7f7d54b-fkfs7 to ip-10-0-136-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-mnz78

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-mnz78 to ip-10-0-136-157.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-nq6b5 to ip-10-0-131-21.ec2.internal

openshift-ingress

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq to ip-10-0-136-157.ec2.internal

models-as-a-service

payload-processing-external-model-5fb7f7d54b-mfmxn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5fb7f7d54b-mfmxn to ip-10-0-136-156.ec2.internal

openshift-ingress

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr to ip-10-0-131-21.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-59cf4dc6bfstm28

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-59cf4dc6bfstm28 to ip-10-0-136-156.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-899c649cb-gs59t

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-899c649cb-gs59t to ip-10-0-136-157.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-899c649cb-dtn6g

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-899c649cb-dtn6g to ip-10-0-136-156.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-899c649cb-7cjsf

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-899c649cb-7cjsf to ip-10-0-131-21.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-hbkp4

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hbkp4 to ip-10-0-131-21.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx to ip-10-0-136-157.ec2.internal

opendatahub

test-curl-7552-fd65ec

Scheduled

Successfully assigned opendatahub/test-curl-7552-fd65ec to ip-10-0-136-156.ec2.internal

opendatahub

test-curl-7552-c259b0

Scheduled

Successfully assigned opendatahub/test-curl-7552-c259b0 to ip-10-0-136-156.ec2.internal

models-as-a-service

payload-processing-external-model-67ddf5bb68-5ss2r

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-67ddf5bb68-5ss2r to ip-10-0-136-156.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-d2tc9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-d2tc9 to ip-10-0-131-21.ec2.internal

opendatahub

test-curl-7552-8bb9b0

Scheduled

Successfully assigned opendatahub/test-curl-7552-8bb9b0 to ip-10-0-136-156.ec2.internal

openshift-ingress

router-default-68d4c65fcc-47wdn

FailedScheduling

no nodes available to schedule pods

opendatahub

test-curl-7552-4ccea5

Scheduled

Successfully assigned opendatahub/test-curl-7552-4ccea5 to ip-10-0-136-156.ec2.internal

openshift-ingress

router-default-68d4c65fcc-47wdn

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-68d4c65fcc-47wdn

Scheduled

Successfully assigned openshift-ingress/router-default-68d4c65fcc-47wdn to ip-10-0-131-21.ec2.internal

opendatahub

test-curl-7552-30c4ba

Scheduled

Successfully assigned opendatahub/test-curl-7552-30c4ba to ip-10-0-136-156.ec2.internal

models-as-a-service

payload-processing-external-model-6b878ffdf9-qk8f6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6b878ffdf9-qk8f6 to ip-10-0-131-21.ec2.internal

opendatahub

test-curl-7549-f0c17f

Scheduled

Successfully assigned opendatahub/test-curl-7549-f0c17f to ip-10-0-136-156.ec2.internal

opendatahub

test-curl-7549-9220ab

Scheduled

Successfully assigned opendatahub/test-curl-7549-9220ab to ip-10-0-136-156.ec2.internal

opendatahub

test-curl-7546-35d504

Scheduled

Successfully assigned opendatahub/test-curl-7546-35d504 to ip-10-0-136-156.ec2.internal

models-as-a-service

payload-processing-external-model-75fdc85848-47q46

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-75fdc85848-47q46 to ip-10-0-136-157.ec2.internal

openshift-ingress

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv to ip-10-0-136-157.ec2.internal

opendatahub

test-curl-7540-79de5a

Scheduled

Successfully assigned opendatahub/test-curl-7540-79de5a to ip-10-0-136-156.ec2.internal

models-as-a-service

payload-processing-external-model-86bc8645b9-btzdb

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-86bc8645b9-btzdb to ip-10-0-136-156.ec2.internal

models-as-a-service

payload-processing-external-model-9888fbfd6-ggrmc

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-9888fbfd6-ggrmc to ip-10-0-131-21.ec2.internal

models-as-a-service

payload-processing-external-model-7f548df5c7-g5nft

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7f548df5c7-g5nft to ip-10-0-136-156.ec2.internal

opendatahub

odh-model-controller-769875db56-5wlcw

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-5wlcw to ip-10-0-131-21.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-25bhl

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-25bhl to ip-10-0-131-21.ec2.internal

opendatahub

maas-controller-5cd76fccff-vhrnn

Scheduled

Successfully assigned opendatahub/maas-controller-5cd76fccff-vhrnn to ip-10-0-131-21.ec2.internal

opendatahub

maas-controller-5b9c46cb8-xlhtv

Scheduled

Successfully assigned opendatahub/maas-controller-5b9c46cb8-xlhtv to ip-10-0-131-21.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-w4h5l

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-w4h5l to ip-10-0-136-156.ec2.internal

models-as-a-service

payload-processing-external-model-78fb45f9df-z72zg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-78fb45f9df-z72zg to ip-10-0-131-21.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-7m5zl

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-7m5zl to ip-10-0-136-156.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-j48f9

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-j48f9 to ip-10-0-131-21.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-zpt8v

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-zpt8v to ip-10-0-131-21.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-lsn4g

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-lsn4g to ip-10-0-136-157.ec2.internal

opendatahub

ai-gateway-controller-6f5dcfbf7c-4gxsx

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6f5dcfbf7c-4gxsx to ip-10-0-136-157.ec2.internal

openshift-jobset-operator

jobset-controller-manager-667b7b4d9b-znklp

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-667b7b4d9b-znklp to ip-10-0-136-157.ec2.internal

models-as-a-service

payload-processing-external-model-bb987f6c7-gdbp2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-bb987f6c7-gdbp2 to ip-10-0-131-21.ec2.internal

models-as-a-service

payload-processing-external-model-9888fbfd6-xfvf9

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-9888fbfd6-xfvf9 to ip-10-0-136-157.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-68d4c65fcc from 0 to 1

openshift-ingress

replicaset-controller

router-default-68d4c65fcc

SuccessfulCreate

Created pod: router-default-68d4c65fcc-47wdn

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-68d4c65fcc-47wdn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-68d4c65fcc-47wdn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-68d4c65fcc-47wdn

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-68d4c65fcc-47wdn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-68d4c65fcc-47wdn

Created

Container created

openshift-ingress

kubelet

router-default-68d4c65fcc-47wdn

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-jkfxf

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-jkfxf

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jkfxf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jkfxf

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jkfxf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.123s (3.123s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jkfxf

Created

Container created
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jkfxf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jkfxf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-856b6dffcf-vdw7b

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-gmgjs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-856b6dffcf from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-vdw7b

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-856b6dffcf

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-856b6dffcf-vdw7b

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-vdw7b

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-vdw7b

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-vdw7b

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.735s (2.735s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.7s (2.7s including waiting). Image size: 183555333 bytes.

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-d5mxp

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-d5mxp

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-d5mxp

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-d5mxp

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 1.652s (1.652s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-d5mxp

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-d5mxp

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-d5mxp_9b65057d-53ad-457b-a58a-fb48f9c9d6a9 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-899c649cb from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-899c649cb

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-899c649cb-7cjsf

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-7cjsf

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-899c649cb-gs59t

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-899c649cb

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-899c649cb-gs59t

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-899c649cb-dtn6g

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-dtn6g

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-gs59t

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-899c649cb

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-899c649cb-dtn6g

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-899c649cb-7cjsf

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-7cjsf

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-dtn6g

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-dtn6g

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.646s (2.646s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-7cjsf

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.745s (2.745s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-gs59t

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.685s (2.685s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-dtn6g

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-gs59t

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-7cjsf

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-gs59t

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-dtn6g

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-gs59t

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 336ms (336ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-7cjsf

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-7cjsf

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 296ms (296ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-7cjsf

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-7cjsf

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-gs59t

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-dtn6g

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-dtn6g

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 260ms (260ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-gs59t

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-dtn6g

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-899c649cb-gs59t

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

opendatahub-operator-controller-manager-899c649cb-dtn6g_44b97de2-0cef-4c3e-a88f-f38a29387a43

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-899c649cb-dtn6g_44b97de2-0cef-4c3e-a88f-f38a29387a43 became leader

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-l7tsw

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-l7tsw

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-l7tsw

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-gjq75

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-l7tsw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.347s (2.347s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-l7tsw

Started

Container started

kuadrant-system

authorino-operator-7b7bb4bc77-l7tsw_db4cd310-6c52-4776-8636-0bfec022d7be

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-l7tsw_db4cd310-6c52-4776-8636-0bfec022d7be became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-l7tsw

Created

Container created
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-cxhcb

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-cxhcb

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-cxhcb

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-774gh

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-774gh

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-774gh

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-cxhcb

Created

Container created

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-cxhcb_bee5ded3-7d7a-41fa-97e8-71f5275136ab

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-cxhcb_bee5ded3-7d7a-41fa-97e8-71f5275136ab became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-cxhcb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.207s (5.207s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-cxhcb

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-ltl6h

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-vpn5l

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-ltl6h

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-ltl6h

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-s6zvf

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-vpn5l

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-vpn5l

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-s6zvf

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-s6zvf

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-5w9v5

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-5w9v5

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-5w9v5

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-ingress

kubelet

kube-auth-proxy-5587c8dd5c-htpqs

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-s6zvf

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.751s (2.751s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-s6zvf

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-s6zvf

Started

Container started

openshift-ingress

multus

kube-auth-proxy-5587c8dd5c-htpqs

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-5587c8dd5c

SuccessfulCreate

Created pod: kube-auth-proxy-5587c8dd5c-gs8xq

openshift-ingress

replicaset-controller

kube-auth-proxy-5587c8dd5c

SuccessfulCreate

Created pod: kube-auth-proxy-5587c8dd5c-htpqs

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5587c8dd5c from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-59cf4dc6bf

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-59cf4dc6bfstm28

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-59cf4dc6bf from 0 to 1

openshift-ingress

multus

kube-auth-proxy-5587c8dd5c-gs8xq

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5587c8dd5c-gs8xq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-59cf4dc6bfstm28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-774gh

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-774gh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 9.84s (9.84s including waiting). Image size: 190804149 bytes.

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-59cf4dc6bfstm28

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-59cf4dc6bfstm28

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-59cf4dc6bfstm28

Created

Container created
(x3)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-5w9v5

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.986s (2.986s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-ltl6h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 6.031s (6.031s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-vpn5l

Started

Container started

kuadrant-system

limitador-operator-controller-manager-5778bb4449-ltl6h_70039ce1-c2fe-4440-b577-39de8df527ff

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-ltl6h_70039ce1-c2fe-4440-b577-39de8df527ff became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-ltl6h

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-vpn5l

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-vpn5l

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.259s (6.259s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-ltl6h

Created

Container created

kuadrant-system

dns-operator-controller-manager-8557cbdb84-774gh_784f7f3b-80cd-433f-96b9-e13b030e85ef

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-774gh_784f7f3b-80cd-433f-96b9-e13b030e85ef became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-774gh

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-5w9v5

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-5w9v5

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5587c8dd5c-gs8xq

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5587c8dd5c-gs8xq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.667s (2.667s including waiting). Image size: 188904677 bytes.

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-8p5kz

openshift-ingress

kubelet

kube-auth-proxy-5587c8dd5c-htpqs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.502s (2.502s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5587c8dd5c-htpqs

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5587c8dd5c-htpqs

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sh9g6

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-sh9g6

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-5587c8dd5c-gs8xq

Started

Container started
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

multus

limitador-limitador-74dfcfb894-sh9g6

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-5nrtq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-5nrtq

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-8p5kz

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

multus

limitador-limitador-7c9b87d574-8p5kz

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-gx9tg

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-5nrtq

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

authorino-56c6c9ddd5-gx9tg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

authorino-56c6c9ddd5-gx9tg

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-8p5kz

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-5nrtq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.623s (1.623s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sh9g6

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-5nrtq

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-8p5kz

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sh9g6

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-8p5kz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.994s (1.994s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sh9g6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.427s (2.427s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-5nrtq

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-gx9tg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.876s (1.876s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-5nrtq

kuadrant-system

kubelet

authorino-56c6c9ddd5-gx9tg

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-gx9tg

Created

Container created

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-q7c24

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-j48f9

cert-manager

kubelet

cert-manager-597b95cb84-q7c24

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-q7c24

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-q7c24

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

multus

cert-manager-597b95cb84-q7c24

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-5nrtq

Killing

Stopping container authorino

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-j48f9

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-j48f9

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-j48f9

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-j48f9

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-j48f9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.45s (1.45s including waiting). Image size: 195729000 bytes.

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-sh9g6

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-sh9g6

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kserve-module-controller-manager-7566cf5fc8-j48f9_7cf5c0ae-b1c3-46ea-a747-2ce7b10bfaf2

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-j48f9_7cf5c0ae-b1c3-46ea-a747-2ce7b10bfaf2 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-n49xq"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-v6hvt"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-667b7b4d9b

SuccessfulCreate

Created pod: jobset-controller-manager-667b7b4d9b-znklp

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-667b7b4d9b from 0 to 1

openshift-jobset-operator

multus

jobset-controller-manager-667b7b4d9b-znklp

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-667b7b4d9b-znklp

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5b9c46cb8 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5cd76fccff from 0 to 1

opendatahub

replicaset-controller

maas-controller-5cd76fccff

SuccessfulCreate

Created pod: maas-controller-5cd76fccff-vhrnn

opendatahub

replicaset-controller

maas-controller-5b9c46cb8

SuccessfulCreate

Created pod: maas-controller-5b9c46cb8-xlhtv

opendatahub

multus

maas-controller-5b9c46cb8-xlhtv

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-667b7b4d9b-znklp

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-667b7b4d9b-znklp

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.488s (2.488s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-667b7b4d9b-znklp

Created

Container created

opendatahub

multus

maas-controller-5cd76fccff-vhrnn

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5cd76fccff-vhrnn

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:b066f93ae0e71a4705df72b6d9af6d4f0a4a77c57d9232d937cd764e5dc476ea"

openshift-jobset-operator

jobset-controller-manager-667b7b4d9b-znklp_38f55f66-dd16-4a1d-9ae2-a856144a0e1a

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-667b7b4d9b-znklp_38f55f66-dd16-4a1d-9ae2-a856144a0e1a became leader

opendatahub

kubelet

maas-controller-5cd76fccff-vhrnn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:b066f93ae0e71a4705df72b6d9af6d4f0a4a77c57d9232d937cd764e5dc476ea" in 2.811s (2.811s including waiting). Image size: 200069639 bytes.

opendatahub

maas-controller-5cd76fccff-vhrnn_e9753c1a-7f1b-4856-b995-6719a3f1da6a

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5cd76fccff-vhrnn_e9753c1a-7f1b-4856-b995-6719a3f1da6a became leader

opendatahub

kubelet

maas-controller-5b9c46cb8-xlhtv

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:b066f93ae0e71a4705df72b6d9af6d4f0a4a77c57d9232d937cd764e5dc476ea" in 2.596s (2.596s including waiting). Image size: 200069639 bytes.

opendatahub

kubelet

maas-controller-5cd76fccff-vhrnn

Created

Container created

opendatahub

kubelet

maas-controller-5cd76fccff-vhrnn

Started

Container started

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-hbkp4

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-hbkp4

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-hbkp4

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

kubelet

maas-controller-5cd76fccff-vhrnn

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-5cd76fccff

SuccessfulDelete

Deleted pod: maas-controller-5cd76fccff-vhrnn

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-5cd76fccff from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-hbkp4

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.516s (10.516s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-hbkp4

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-hbkp4

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-7dd27

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-7dd27

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7dd27

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7dd27

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w4h5l

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-7dd27

Started

Container started

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-5wlcw

opendatahub

multus

kserve-controller-manager-776cc66d47-zpt8v

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-w4h5l

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-w4h5l

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-zpt8v

opendatahub

kubelet

kserve-controller-manager-776cc66d47-zpt8v

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

model-serving-api-75bd89fdfc-25bhl

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-25bhl

opendatahub

kubelet

odh-model-controller-769875db56-5wlcw

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-jkfxf

opendatahub

multus

odh-model-controller-769875db56-5wlcw

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jkfxf

Killing

Stopping container discovery

opendatahub

kubelet

model-serving-api-75bd89fdfc-25bhl

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w4h5l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 1.812s (1.812s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w4h5l

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w4h5l

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-zpt8v

Created

Container created

opendatahub

maas-controller-5b9c46cb8-xlhtv_f2d76a08-2a38-4a88-9370-fb19145a18d2

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5b9c46cb8-xlhtv_f2d76a08-2a38-4a88-9370-fb19145a18d2 became leader

opendatahub

kubelet

model-serving-api-75bd89fdfc-25bhl

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-zpt8v

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-25bhl

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-25bhl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.156s (2.156s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-zpt8v

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.563s (2.563s including waiting). Image size: 247676581 bytes.

opendatahub

odh-model-controller-769875db56-5wlcw_1c26f68b-f8fc-48f6-93e3-3035d8cd19ff

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-5wlcw_1c26f68b-f8fc-48f6-93e3-3035d8cd19ff became leader

opendatahub

kserve-controller-manager-776cc66d47-zpt8v_4f07bf42-14fa-48b7-a807-bd2bf46c7119

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-zpt8v_4f07bf42-14fa-48b7-a807-bd2bf46c7119 became leader

opendatahub

kubelet

odh-model-controller-769875db56-5wlcw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.949s (2.949s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-5wlcw

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-5wlcw

Created

Container created

opendatahub

llmisvc-controller-manager-869d5dcc5d-w4h5l_cfed4852-2be3-416c-9695-cf21807caa03

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-w4h5l_cfed4852-2be3-416c-9695-cf21807caa03 became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Created

Container created

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-rgwv5

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-8687975cdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-rgwv5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-6cv8p

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

authorino-8687975cdd

SuccessfulCreate

Created pod: authorino-8687975cdd-6l8tp

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-6cv8p

kuadrant-system

kubelet

authorino-8687975cdd-6l8tp

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-8687975cdd-6l8tp

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-gx9tg

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-8687975cdd-6l8tp

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-gx9tg

kuadrant-system

kubelet

authorino-8687975cdd-6l8tp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 872ms (872ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-8687975cdd-6l8tp

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Unhealthy

Startup probe failed: Get "http://10.134.0.16:15021/healthz/ready": dial tcp 10.134.0.16:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

ProbeError

Startup probe error: Get "http://10.134.0.16:15021/healthz/ready": dial tcp 10.134.0.16:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

llmisvc-controller-manager-6466c554d8-7m5zl

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-7m5zl

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-7m5zl

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-7m5zl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 254ms (254ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-7m5zl

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-7m5zl

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w4h5l

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-w4h5l

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lsn4g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-lsn4g

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-lsn4g

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lsn4g

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lsn4g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.428s (1.428s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lsn4g

Created

Container created

opendatahub

ai-gateway-controller-7d85675f98-lsn4g_0ca524b9-284d-4733-89f9-1c27fe92cff0

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-lsn4g_0ca524b9-284d-4733-89f9-1c27fe92cff0 became leader

openshift-ingress

multus

payload-processing-55fbbbf9dc-hxh82

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-hxh82

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-f9sls

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hxh82

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-f9sls

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-f9sls

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-f9sls

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-f9sls

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-f9sls

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.024s (2.024s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hxh82

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hxh82

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.046s (2.046s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hxh82

Started

Container started

opendatahub

replicaset-controller

ai-gateway-controller-6f5dcfbf7c

SuccessfulCreate

Created pod: ai-gateway-controller-6f5dcfbf7c-4gxsx

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6f5dcfbf7c from 0 to 1

opendatahub

kubelet

ai-gateway-controller-6f5dcfbf7c-4gxsx

Created

Container created

opendatahub

kubelet

ai-gateway-controller-6f5dcfbf7c-4gxsx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 391ms (391ms including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-6f5dcfbf7c-4gxsx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-6f5dcfbf7c-4gxsx

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-6f5dcfbf7c-4gxsx

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-7m5zl_f87a4ae0-4829-4b35-a434-402f14db3f84

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-7m5zl_f87a4ae0-4829-4b35-a434-402f14db3f84 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-lsn4g

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-lsn4g

opendatahub

kubelet

maas-controller-5b9c46cb8-xlhtv

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:b066f93ae0e71a4705df72b6d9af6d4f0a4a77c57d9232d937cd764e5dc476ea" in 409ms (409ms including waiting). Image size: 200069639 bytes.
(x2)

opendatahub

kubelet

maas-controller-5b9c46cb8-xlhtv

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-5b9c46cb8-xlhtv

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-5b9c46cb8-xlhtv

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:b066f93ae0e71a4705df72b6d9af6d4f0a4a77c57d9232d937cd764e5dc476ea"

opendatahub

ai-gateway-controller-6f5dcfbf7c-4gxsx_62416205-30b4-4b18-8937-956bd4b134d9

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6f5dcfbf7c-4gxsx_62416205-30b4-4b18-8937-956bd4b134d9 became leader

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-2trls

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-2trls

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-2trls

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

opendatahub

maas-controller-5b9c46cb8-xlhtv_abe601dc-657e-4a97-9625-cf577bac31cd

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5b9c46cb8-xlhtv_abe601dc-657e-4a97-9625-cf577bac31cd became leader

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-2trls

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.301s (1.301s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-2trls

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-2trls

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-bfqc5

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-bfqc5

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-bfqc5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-bnv8m

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-bnv8m

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 171ms (171ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-bfqc5

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-bnv8m

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-bnv8m

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-bfqc5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 979ms (979ms including waiting). Image size: 98346788 bytes.

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-bnv8m

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-bnv8m

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-bfqc5

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-xcmm7

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-xcmm7

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-xcmm7

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-xcmm7

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-xcmm7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 168ms (168ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-xcmm7

Started

Container started

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j9gvf

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j9gvf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 205ms (205ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j9gvf

Started

Container started

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j9gvf

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j9gvf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j9gvf

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-4gck9

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-4gck9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-4gck9

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-lq8t9

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-lq8t9

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-lq8t9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 203ms (203ms including waiting). Image size: 98346788 bytes.

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-lq8t9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-4gck9

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-lq8t9

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-4gck9

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-lq8t9

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-4gck9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.944s (1.944s including waiting). Image size: 78208878 bytes.

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 184ms (184ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

kuadrant-system

replicaset-controller

authorino-5c695f6bc5

SuccessfulCreate

Created pod: authorino-5c695f6bc5-nbdsf

kuadrant-system

kubelet

authorino-5c695f6bc5-nbdsf

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-5c695f6bc5-nbdsf

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5c695f6bc5-nbdsf

Started

Container started
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-8687975cdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-8687975cdd

SuccessfulDelete

Deleted pod: authorino-8687975cdd-6l8tp

kuadrant-system

kubelet

authorino-5c695f6bc5-nbdsf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 667ms (667ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-8687975cdd-6l8tp

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-5c695f6bc5-nbdsf

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-hcd5s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-94gsm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-294zx

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-294zx

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-294zx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-94gsm

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-94gsm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.764s (2.764s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-94gsm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-94gsm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-94gsm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.668s (2.668s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-294zx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-294zx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.64s (2.64s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-294zx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-94gsm

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-94gsm

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-294zx

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-294zx

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-c7qkl

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-nq6b5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-cts4j

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7qkl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mnz78

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cts4j

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cts4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-cts4j

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7qkl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mnz78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7qkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-c7qkl

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cts4j

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-mnz78

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mnz78

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-mnz78

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7qkl

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cts4j

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cts4j

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mnz78

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mnz78

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7qkl

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-25447e22-openshift-default-56df68cbf9

SuccessfulCreate

Created pod: e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

openshift-ingress

deployment-controller

e2e-migrate-353db9f5-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-353db9f5-gw-openshift-default-7d885d947c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-25447e22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-25447e22

openshift-ingress

gateway_labeler_controller

e2e-migrate-353db9f5-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-353db9f5-gw

openshift-ingress

replicaset-controller

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c

SuccessfulCreate

Created pod: e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

openshift-ingress

deployment-controller

e2e-ait-25447e22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-25447e22-openshift-default-56df68cbf9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-ac0736b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ac0736b6

openshift-ingress

deployment-controller

e2e-ait-ac0736b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ac0736b6-openshift-default-65bc984bbf from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-ac0736b6-openshift-default-65bc984bbf

SuccessfulCreate

Created pod: e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

openshift-ingress

multus

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-9df039e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9df039e4

openshift-ingress

multus

e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-9df039e4-openshift-default-7c9847cc65

SuccessfulCreate

Created pod: e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq

openshift-ingress

deployment-controller

e2e-ait-9df039e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9df039e4-openshift-default-7c9847cc65 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-353db9f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-353db9f5-69b57cffb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-353db9f5-597d5d686c-xklsb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-353db9f5-597d5d686c-xklsb

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-bncsq

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-353db9f5-69b57cffb7

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-353db9f5-69b57cffb7-6wt7s
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-353db9f5-69b57cffb7

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-353db9f5-69b57cffb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-353db9f5: serviceaccount "payload-processing-e2e-migrate-353db9f5" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-bncsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-migrate-353db9f5-597d5d686c-xklsb

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-353db9f5-597d5d686c-xklsb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-353db9f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-353db9f5-597d5d686c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-353db9f5-597d5d686c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-353db9f5-597d5d686c-xklsb

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-bncsq

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-bncsq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-353db9f5-69b57cffb7-6wt7s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-migrate-353db9f5-69b57cffb7-6wt7s

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-353db9f5-597d5d686c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-353db9f5-597d5d686c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-353db9f5: serviceaccount "payload-processing-e2e-migrate-353db9f5" not found

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 8 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-bncsq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-353db9f5-69b57cffb7-6wt7s

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-25447e22-569c6647cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-25447e22-569c6647cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-25447e22: serviceaccount "payload-processing-e2e-ait-25447e22" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-353db9f5-69b57cffb7-6wt7s

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ait-25447e22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-25447e22-5998f5c689 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-25447e22-5998f5c689

FailedCreate

Error creating: pods "payload-processing-e2e-ait-25447e22-5998f5c689-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-25447e22: serviceaccount "payload-processing-e2e-ait-25447e22" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-25447e22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-25447e22-569c6647cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-25447e22-569c6647cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-25447e22-569c6647cf-ql62d

openshift-ingress

multus

payload-processing-e2e-ait-25447e22-5998f5c689-sxqzp

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-25447e22-5998f5c689-sxqzp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-25447e22-5998f5c689-sxqzp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-25447e22-5998f5c689-sxqzp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ac0736b6-54b457b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ac0736b6-54b457b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ac0736b6: serviceaccount "payload-processing-e2e-ait-ac0736b6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ac0736b6-54b457b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ac0736b6-54b457b99-m5xt5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ac0736b6-dc9cbf5c9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ac0736b6-dc9cbf5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ac0736b6: serviceaccount "payload-processing-e2e-ait-ac0736b6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ac0736b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ac0736b6-54b457b99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ac0736b6-dc9cbf5c9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ac0736b6-dc9cbf5c9-xsqhm

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ac0736b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ac0736b6-dc9cbf5c9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-25447e22-569c6647cf-ql62d

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-25447e22-569c6647cf-ql62d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-25447e22-5998f5c689

SuccessfulCreate

Created pod: payload-processing-e2e-ait-25447e22-5998f5c689-sxqzp

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-25447e22-569c6647cf-ql62d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-25447e22-569c6647cf-ql62d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ac0736b6-54b457b99-m5xt5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-derive-7ef0e96a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-ac0736b6-dc9cbf5c9-xsqhm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-ac0736b6-dc9cbf5c9-xsqhm

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ac0736b6-54b457b99-m5xt5

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-derive-7ef0e96a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-7ef0e96a

openshift-ingress

kubelet

payload-processing-e2e-ait-ac0736b6-dc9cbf5c9-xsqhm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-ac0736b6-54b457b99-m5xt5

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf

SuccessfulCreate

Created pod: e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ac0736b6-54b457b99-m5xt5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-ac0736b6-dc9cbf5c9-xsqhm

Started

Container started

openshift-ingress

multus

e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9df039e4-866c7df7b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9df039e4-866c7df7b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9df039e4: serviceaccount "payload-processing-e2e-ait-9df039e4" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-9df039e4-866c7df7b7-56zff

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9df039e4-866c7df7b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9df039e4-866c7df7b7-56zff

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9df039e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9df039e4-866c7df7b7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9df039e4-866c7df7b7-56zff

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9df039e4-84bfcd89ff

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9df039e4-84bfcd89ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9df039e4: serviceaccount "payload-processing-e2e-ait-9df039e4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9df039e4-84bfcd89ff

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9df039e4-84bfcd89ff-bkr7c

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9df039e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9df039e4-84bfcd89ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9df039e4-866c7df7b7-56zff

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-9df039e4-84bfcd89ff-bkr7c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-9df039e4-84bfcd89ff-bkr7c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-9df039e4-84bfcd89ff-bkr7c

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-9df039e4-84bfcd89ff-bkr7c

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9df039e4-866c7df7b7-56zff

Created

Container created
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-bncsq

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-bncsq

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7ef0e96a: serviceaccount "payload-processing-e2e-derive-7ef0e96a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-7ef0e96a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-7ef0e96a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7-gv4rc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7ef0e96a: serviceaccount "payload-processing-e2e-derive-7ef0e96a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947-vkvqr

openshift-ingress

kubelet

payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7-gv4rc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7-gv4rc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7-gv4rc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7-gv4rc

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947-vkvqr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947-vkvqr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947-vkvqr

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947-vkvqr

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9df039e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9df039e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-353db9f5-69b57cffb7-6wt7s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-353db9f5-597d5d686c-xklsb

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-353db9f5-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-353db9f5-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-25447e22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-25447e22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9df039e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9df039e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9df039e4-866c7df7b7-56zff

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-9df039e4-84bfcd89ff-bkr7c

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-7ef0e96a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-7ef0e96a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ac0736b6-54b457b99-m5xt5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ac0736b6-dc9cbf5c9-xsqhm

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-106555

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-106555

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 0 to 1

openshift-ingress

kubelet

e2e-ait-9df039e4-openshift-default-7c9847cc65-xmntq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-25447e22-569c6647cf-ql62d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-25447e22-5998f5c689-sxqzp

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9
(x5)

openshift-ingress

kubelet

e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-4b5989

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-4b5989
(x5)

openshift-ingress

kubelet

e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-353db9f5-gw-openshift-default-7d885d947c-k9fxj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-ac0736b6-openshift-default-65bc984bbf-vrcz2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-25447e22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ac0736b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-25447e22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ac0736b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7ef0e96a-7c8b45947-vkvqr

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-c16684

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-c16684

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-7ef0e96a-7b4d7b87c7-gv4rc

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-25447e22-openshift-default-56df68cbf9-5tstr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-106555

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-106555-659c88c8f5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-106555: serviceaccount "payload-processing-e2e-worker-w3-106555" not found

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-cc45a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-cc45a7

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-106555

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-106555-849b8bdbd5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-106555-849b8bdbd5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-106555-849b8bdbd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-106555: serviceaccount "payload-processing-e2e-worker-w3-106555" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4b5989-94b469d6f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-4b5989-94b469d6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4b5989: serviceaccount "payload-processing-e2e-worker-w0-4b5989" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-106555-849b8bdbd5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-4b5989

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-4b5989-94b469d6f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-qgl9q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-4b5989

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4b5989: serviceaccount "payload-processing-e2e-worker-w0-4b5989" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-qgl9q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b5989-94b469d6f-qd76b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-qgl9q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-qgl9q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-qgl9q

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-4b5989-94b469d6f-qd76b

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4b5989-94b469d6f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-4b5989-94b469d6f-qd76b

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b5989-94b469d6f-qd76b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b5989-94b469d6f-qd76b

Started

Container started

openshift-ingress

kubelet

e2e-derive-7ef0e96a-openshift-default-54cf9cd8bf-rng5q

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-994336

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-994336

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-c16684

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-c16684-685b865b6c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-c16684-685b865b6c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-c16684-685b865b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-c16684: serviceaccount "payload-processing-e2e-worker-w2-c16684" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-c16684: serviceaccount "payload-processing-e2e-worker-w2-c16684" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-c16684

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7 from 0 to 1

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-gjj44

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-gjj44

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-gjj44

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-gjj44

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-c16684-685b865b6c-qbtqr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-c16684-685b865b6c-qbtqr

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-c16684-685b865b6c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-c16684-685b865b6c-qbtqr

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-gjj44

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-cc45a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-c16684-685b865b6c-qbtqr

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-cc45a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-cc45a7-67fd74fc57 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-c16684-685b865b6c-qbtqr

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-cc45a7-67fd74fc57

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-cc45a7: serviceaccount "payload-processing-e2e-worker-w4-cc45a7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-lpr6x
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-cc45a7: serviceaccount "payload-processing-e2e-worker-w4-cc45a7" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-d2tc9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-lpr6x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-d2tc9

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-lpr6x

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-d2tc9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-d2tc9

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-cc45a7-67fd74fc57

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-d2tc9

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-lpr6x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-lpr6x

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-994336-55bfbff87f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-994336: serviceaccount "payload-processing-e2e-worker-w1-994336" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-994336

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-994336-55bfbff87f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-994336-55bfbff87f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-whppz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-994336-776fb75b4f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-994336-776fb75b4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-994336: serviceaccount "payload-processing-e2e-worker-w1-994336" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-994336

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-994336-776fb75b4f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-994336-776fb75b4f-628xt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-whppz

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-994336-776fb75b4f-628xt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-994336-776fb75b4f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-994336-776fb75b4f-628xt

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-994336-776fb75b4f-628xt

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-994336-776fb75b4f-628xt

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-whppz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-whppz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-whppz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

Started

Container started

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-78fb45f9df from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

Started

Container started
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-78fb45f9df

FailedCreate

Error creating: pods "payload-processing-external-model-78fb45f9df-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-78fb45f9df

SuccessfulCreate

Created pod: payload-processing-external-model-78fb45f9df-z72zg

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-78fb45f9df-z72zg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-78fb45f9df-z72zg

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-78fb45f9df-z72zg

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-78fb45f9df-z72zg

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

Started

Container started

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-6b878ffdf9-qk8f6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-58847f9fc5-f9pgk

models-as-a-service

multus

payload-processing-external-model-6b878ffdf9-qk8f6

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6b878ffdf9 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-6b878ffdf9

SuccessfulCreate

Created pod: payload-processing-external-model-6b878ffdf9-qk8f6

models-as-a-service

kubelet

payload-processing-external-model-6b878ffdf9-qk8f6

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6b878ffdf9-qk8f6

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 9 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

models-as-a-service

replicaset-controller

payload-processing-external-model-78fb45f9df

SuccessfulDelete

Deleted pod: payload-processing-external-model-78fb45f9df-z72zg

models-as-a-service

kubelet

payload-processing-external-model-78fb45f9df-z72zg

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-78fb45f9df from 1 to 0

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 1 to 2

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-9888fbfd6

SuccessfulCreate

Created pod: payload-processing-external-model-9888fbfd6-ggrmc

models-as-a-service

multus

payload-processing-external-model-9888fbfd6-ggrmc

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-9888fbfd6-ggrmc

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-9888fbfd6-ggrmc

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-9888fbfd6-ggrmc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6b878ffdf9 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-6b878ffdf9-qk8f6

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-6b878ffdf9

SuccessfulDelete

Deleted pod: payload-processing-external-model-6b878ffdf9-qk8f6

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-bb987f6c7 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-bb987f6c7

SuccessfulCreate

Created pod: payload-processing-external-model-bb987f6c7-gdbp2

models-as-a-service

kubelet

payload-processing-external-model-bb987f6c7-gdbp2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 2 to 4

models-as-a-service

multus

payload-processing-external-model-bb987f6c7-gdbp2

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-bb987f6c7-gdbp2

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-bb987f6c7-gdbp2

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

Created

Container created

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

Created

Container created

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-9888fbfd6

SuccessfulDelete

Deleted pod: payload-processing-external-model-9888fbfd6-ggrmc
(x7)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-9888fbfd6 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-9888fbfd6-ggrmc

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 4 to 7

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

Started

Container started

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-9888fbfd6

SuccessfulCreate

Created pod: payload-processing-external-model-9888fbfd6-xfvf9
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-9888fbfd6 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-9888fbfd6-xfvf9

Started

Container started

models-as-a-service

multus

payload-processing-external-model-9888fbfd6-xfvf9

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-9888fbfd6-xfvf9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-9888fbfd6-xfvf9

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

Created

Container created

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

Created

Container created

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

Created

Container created

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 3 to 5

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-bb987f6c7-gdbp2

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-9888fbfd6-xfvf9

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 7 to 10
(x9)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x9)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

Started

Container started

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

ProbeError

Readiness probe error: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

Unhealthy

Readiness probe failed: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 5 to 6

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q
(x5)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

Created

Container created

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

Started

Container started

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulCreate

Created pod: e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

Created

Container created

openshift-ingress

multus

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6
(x8)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6

Started

Container started

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6

Created

Container created

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

ProbeError

Startup probe error: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

Unhealthy

Startup probe failed: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

ProbeError

Startup probe error: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

Unhealthy

Startup probe failed: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

Unhealthy

Readiness probe failed: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

ProbeError

Readiness probe error: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

ProbeError

Readiness probe error: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

Unhealthy

Readiness probe failed: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

Unhealthy

Readiness probe failed: Get "http://10.132.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

ProbeError

Readiness probe error: Get "http://10.132.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

Created

Container created

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

Unhealthy

Readiness probe failed: Get "http://10.132.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

ProbeError

Readiness probe error: Get "http://10.132.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

Unhealthy

Readiness probe failed: Get "http://10.132.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

ProbeError

Readiness probe error: Get "http://10.132.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

ProbeError

Readiness probe error: Get "http://10.132.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

Unhealthy

Readiness probe failed: Get "http://10.132.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x12)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

Unhealthy

Startup probe failed: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

ProbeError

Startup probe error: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

Unhealthy

Readiness probe failed: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

ProbeError

Readiness probe error: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

Started

Container started

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

Started

Container started

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

ProbeError

Startup probe error: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

Unhealthy

Startup probe failed: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 8 to 9

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-90db52-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-90db52-openshift-default-f788579b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-90db52-openshift-default-f788579b9

SuccessfulCreate

Created pod: e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-a-90db52

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-90db52

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cts4j

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cts4j

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-mt-084d807f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-084d807f

openshift-ingress

deployment-controller

e2e-mt-084d807f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-084d807f-openshift-default-84c8676869 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-084d807f-openshift-default-84c8676869

SuccessfulCreate

Created pod: e2e-mt-084d807f-openshift-default-84c8676869-zqhjh

openshift-ingress

multus

e2e-mt-084d807f-openshift-default-84c8676869-zqhjh

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-90db52

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-90db52-57478fddb7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-90db52-57478fddb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-90db52: serviceaccount "payload-processing-e2e-api-a-90db52" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-90db52: serviceaccount "payload-processing-e2e-api-a-90db52" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-90db52

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-90db52-57478fddb7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc-ltfg6

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-90db52-57478fddb7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-90db52-57478fddb7-vq79w

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc-ltfg6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-084d807f: serviceaccount "payload-processing-e2e-mt-084d807f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc-ltfg6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-084d807f-7648554b69

FailedCreate

Error creating: pods "payload-processing-e2e-mt-084d807f-7648554b69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-084d807f: serviceaccount "payload-processing-e2e-mt-084d807f" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-90db52-57478fddb7-vq79w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-90db52-57478fddb7-vq79w

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-90db52-57478fddb7-vq79w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-90db52-57478fddb7-vq79w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-mt-084d807f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-084d807f-7648554b69 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc-ltfg6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc-ltfg6

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-084d807f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc

openshift-ingress

multus

payload-processing-e2e-mt-084d807f-7648554b69-6k7t8

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-084d807f-7648554b69

SuccessfulCreate

Created pod: payload-processing-e2e-mt-084d807f-7648554b69-6k7t8

openshift-ingress

multus

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-6k7t8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-6k7t8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-6k7t8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-7ac3c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-7ac3c8-openshift-default-845c59dc47 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-7ac3c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-7ac3c8

openshift-ingress

replicaset-controller

e2e-api-a-7ac3c8-openshift-default-845c59dc47

SuccessfulCreate

Created pod: e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf

openshift-ingress

multus

e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-7ac3c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-7ac3c8-76bc49454f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7ac3c8-76bc49454f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-7ac3c8-76bc49454f-vfdpw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7ac3c8-76bc49454f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-7ac3c8-76bc49454f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7ac3c8: serviceaccount "payload-processing-e2e-api-a-7ac3c8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-7ac3c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc-tdlt8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7ac3c8: serviceaccount "payload-processing-e2e-api-a-7ac3c8" not found

openshift-ingress

multus

payload-processing-e2e-api-a-7ac3c8-76bc49454f-vfdpw

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc-tdlt8

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-7ac3c8-76bc49454f-vfdpw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc-tdlt8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-7ac3c8-76bc49454f-vfdpw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-7ac3c8-76bc49454f-vfdpw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc-tdlt8

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc-tdlt8

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 9 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-r4hv9

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-r4hv9

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4hv9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 6 to 10

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-371531-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-371531-openshift-default-d977d868c from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-371531

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-371531

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-371531-openshift-default-d977d868c

SuccessfulCreate

Created pod: e2e-api-b-371531-openshift-default-d977d868c-nzsxr

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

Created

Container created

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-371531-openshift-default-d977d868c-nzsxr

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-371531

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-371531-7b5cd97689 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4hv9

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-371531

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-371531-56c4759659 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4hv9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 9.229s (9.229s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4hv9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-371531-56c4759659-xfppb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-371531-56c4759659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-371531-56c4759659-xfppb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-371531-56c4759659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-371531-56c4759659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-371531: serviceaccount "payload-processing-e2e-api-b-371531" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-371531-56c4759659-xfppb

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-371531-7b5cd97689

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-371531-7b5cd97689-rtfrd
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-371531-7b5cd97689

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-371531-7b5cd97689-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-371531: serviceaccount "payload-processing-e2e-api-b-371531" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-371531-7b5cd97689-rtfrd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-371531-7b5cd97689-rtfrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-371531-7b5cd97689-rtfrd

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4hv9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-371531-7b5cd97689-rtfrd

Started

Container started
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4hv9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-371531-56c4759659-xfppb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.384s (2.384s including waiting). Image size: 125353963 bytes.
(x2)

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-zqhjh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-371531-56c4759659-xfppb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-371531-56c4759659-xfppb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-zqhjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-zqhjh

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-zqhjh

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-zqhjh

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-248b29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-248b29

openshift-ingress

deployment-controller

e2e-api-b-248b29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-248b29-openshift-default-66f64586d5 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-084d807f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-248b29-openshift-default-66f64586d5

SuccessfulCreate

Created pod: e2e-api-b-248b29-openshift-default-66f64586d5-94rjj

openshift-ingress

multus

e2e-api-b-248b29-openshift-default-66f64586d5-94rjj

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-084d807f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-248b29-56d94578bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-248b29-56d94578bc-xhmmn

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-248b29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-248b29-7c8fd468f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-248b29-7c8fd468f5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-248b29-7c8fd468f5-fm992

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-248b29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-248b29-56d94578bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-248b29-56d94578bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-248b29-56d94578bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-248b29: serviceaccount "payload-processing-e2e-api-b-248b29" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-248b29-7c8fd468f5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-248b29-7c8fd468f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-248b29: serviceaccount "payload-processing-e2e-api-b-248b29" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-248b29-7c8fd468f5-fm992

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-248b29-7c8fd468f5-fm992

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-248b29-56d94578bc-xhmmn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-248b29-56d94578bc-xhmmn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-248b29-7c8fd468f5-fm992

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-248b29-56d94578bc-xhmmn

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-248b29-56d94578bc-xhmmn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-248b29-7c8fd468f5-fm992

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7ac3c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7ac3c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-084d807f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-084d807f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-90db52-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-90db52-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-084d807f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-9pvlc

Created

Container created

openshift-ingress

replicaset-controller

e2e-mt-084d807f-openshift-default-84c8676869

SuccessfulCreate

Created pod: e2e-mt-084d807f-openshift-default-84c8676869-9pvlc

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-9pvlc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-9pvlc

Started

Container started

openshift-ingress

multus

e2e-mt-084d807f-openshift-default-84c8676869-9pvlc

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-084d807f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-084d807f-openshift-default-84c8676869 from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-api-a-90db52-57478fddb7-vq79w

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-371531-openshift-default-d977d868c-nzsxr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-371531-openshift-default-d977d868c-nzsxr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-90db52-57f7c9d8dc-ltfg6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-371531-openshift-default-d977d868c-nzsxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-371531-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-371531-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-9pvlc

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-9pvlc

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-371531-openshift-default-d977d868c-nzsxr

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-371531-openshift-default-d977d868c-nzsxr

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-a-08ddf0-openshift-default-6ddc79869c

SuccessfulCreate

Created pod: e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z

openshift-ingress

gateway_labeler_controller

e2e-api-a-08ddf0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-08ddf0

openshift-ingress

deployment-controller

e2e-api-a-08ddf0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-08ddf0-openshift-default-6ddc79869c from 0 to 1

openshift-ingress

multus

e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-08ddf0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-08ddf0-5f75dbd4bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-08ddf0-5f75dbd4bc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-08ddf0-5f75dbd4bc-hs796
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-08ddf0-5f75dbd4bc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-08ddf0-5f75dbd4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-08ddf0: serviceaccount "payload-processing-e2e-api-a-08ddf0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7-vxf9n

openshift-ingress

kubelet

payload-processing-e2e-api-a-08ddf0-5f75dbd4bc-hs796

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-08ddf0: serviceaccount "payload-processing-e2e-api-a-08ddf0" not found

openshift-ingress

multus

payload-processing-e2e-api-a-08ddf0-5f75dbd4bc-hs796

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-08ddf0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7ac3c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7ac3c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7-vxf9n

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7-vxf9n

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7-vxf9n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-08ddf0-5f75dbd4bc-hs796

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-08ddf0-5f75dbd4bc-hs796

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7-vxf9n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-248b29-openshift-default-66f64586d5-94rjj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-248b29-openshift-default-66f64586d5-94rjj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-248b29-openshift-default-66f64586d5-94rjj

Started

Container started

opendatahub

multus

test-curl-7549-f0c17f

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7549-f0c17f

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-248b29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-248b29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-b-248b29-openshift-default-66f64586d5-94rjj

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-248b29-openshift-default-66f64586d5-94rjj

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-94gsm

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

test-curl-7549-f0c17f

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.394s (3.394s including waiting). Image size: 106100986 bytes.
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-294zx

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

test-curl-7549-f0c17f

Started

Container started

opendatahub

kubelet

test-curl-7549-f0c17f

Created

Container created
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-94gsm

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-294zx

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7ac3c8-674d8f78bc-tdlt8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-7ac3c8-76bc49454f-vfdpw

Killing

Stopping container payload-processing

opendatahub

kubelet

test-curl-7549-f0c17f

Killing

Stopping container test-curl-7549-f0c17f
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-371531-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-371531-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-6k7t8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-90db52-openshift-default-f788579b9-xp2jz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-api-b-43fb1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-43fb1b-openshift-default-644c8cb85f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-43fb1b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-43fb1b

openshift-ingress

replicaset-controller

e2e-api-b-43fb1b-openshift-default-644c8cb85f

SuccessfulCreate

Created pod: e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

openshift-ingress

multus

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-6k7t8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-371531-56c4759659-xfppb

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-api-b-371531-7b5cd97689-rtfrd

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-43fb1b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-43fb1b-5799d848d7 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-248b29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-248b29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-43fb1b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-43fb1b-78b54d5df from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-43fb1b-78b54d5df-9nst7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-43fb1b-5799d848d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-43fb1b-5799d848d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-43fb1b: serviceaccount "payload-processing-e2e-api-b-43fb1b" not found

openshift-ingress

multus

payload-processing-e2e-api-b-43fb1b-78b54d5df-9nst7

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-43fb1b-78b54d5df-9nst7

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-43fb1b-5799d848d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-43fb1b-5799d848d7-m7b45

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-43fb1b-78b54d5df

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-43fb1b-78b54d5df-9nst7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-43fb1b-78b54d5df

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-43fb1b-78b54d5df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-43fb1b: serviceaccount "payload-processing-e2e-api-b-43fb1b" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-43fb1b-78b54d5df-9nst7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-43fb1b-5799d848d7-m7b45

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-43fb1b-5799d848d7-m7b45

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-43fb1b-5799d848d7-m7b45

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-43fb1b-5799d848d7-m7b45

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z

Created

Container created

openshift-ingress

kubelet

e2e-api-a-7ac3c8-openshift-default-845c59dc47-wckpf

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-08ddf0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-08ddf0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-6k7t8

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.84:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-6hnlc

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.83:50052" within 1s: context deadline exceeded
(x6)

openshift-ingress

kubelet

e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-248b29-7c8fd468f5-fm992

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-248b29-56d94578bc-xhmmn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-371531-openshift-default-d977d868c-nzsxr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-084d807f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-084d807f-7648554b69

SuccessfulCreate

Created pod: payload-processing-e2e-mt-084d807f-7648554b69-4gw5r

openshift-ingress

deployment-controller

payload-processing-e2e-mt-084d807f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-084d807f-7648554b69 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-084d807f: serviceaccount "payload-processing-e2e-mt-084d807f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-q72sx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-084d807f-7648554b69

FailedCreate

Error creating: pods "payload-processing-e2e-mt-084d807f-7648554b69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-084d807f: serviceaccount "payload-processing-e2e-mt-084d807f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-q72sx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-4gw5r

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-q72sx

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-q72sx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-q72sx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-4gw5r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-4gw5r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-084d807f-7648554b69-4gw5r

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-08ddf0-5f75dbd4bc-hs796

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-08ddf0-54474ff8d7-vxf9n

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-248b29-openshift-default-66f64586d5-94rjj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-f1e791

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-f1e791

openshift-ingress

deployment-controller

e2e-shared-a-w4-f1e791-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-f1e791-openshift-default-85667f7765 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-43fb1b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-08ddf0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-08ddf0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-43fb1b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w4-f1e791-openshift-default-85667f7765

SuccessfulCreate

Created pod: e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

opendatahub

multus

test-curl-7549-9220ab

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7549-9220ab

Created

Container created

opendatahub

kubelet

test-curl-7549-9220ab

Started

Container started

opendatahub

kubelet

test-curl-7549-9220ab

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7549-9220ab

Killing

Stopping container test-curl-7549-9220ab
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-f1e791: serviceaccount "payload-processing-e2e-shared-a-w4-f1e791" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-c9dzw

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-c9dzw

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-f1e791: serviceaccount "payload-processing-e2e-shared-a-w4-f1e791" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-f1e791

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-f1e791

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-j78zf

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-c9dzw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-c9dzw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-c9dzw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-j78zf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-j78zf

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-j78zf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-j78zf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-084d807f-5ff89dd6bc-q72sx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-084d807f-7648554b69-4gw5r

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

ProbeError

Readiness probe error: Get "http://10.134.0.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Unhealthy

Readiness probe failed: Get "http://10.134.0.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-08ddf0-openshift-default-6ddc79869c-m4w7z

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-43fb1b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-43fb1b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-43fb1b-5799d848d7-m7b45

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-43fb1b-78b54d5df-9nst7

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf

SuccessfulCreate

Created pod: e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-c744c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-c744c0

openshift-ingress

deployment-controller

e2e-shared-b-w4-c744c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf from 0 to 1

openshift-ingress

multus

e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-c744c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-c744c0: serviceaccount "payload-processing-e2e-shared-b-w4-c744c0" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-c744c0: serviceaccount "payload-processing-e2e-shared-b-w4-c744c0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-c744c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-5lcg6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-5lcg6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-n7kw6

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-n7kw6

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-n7kw6

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-n7kw6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-5lcg6

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-5lcg6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-n7kw6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-5lcg6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

ProbeError

Readiness probe error: Get "http://10.133.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

Unhealthy

Readiness probe failed: Get "http://10.133.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-fc0d65-openshift-default-84f596955

SuccessfulCreate

Created pod: e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-fc0d65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-fc0d65

openshift-ingress

deployment-controller

e2e-ipp-a-fc0d65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-fc0d65-openshift-default-84f596955 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fc0d65-5657d46c4f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-fc0d65-5657d46c4f-ql4x5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fc0d65-5657d46c4f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-fc0d65-5657d46c4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc0d65: serviceaccount "payload-processing-e2e-ipp-a-fc0d65" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795-mf9jg

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc0d65: serviceaccount "payload-processing-e2e-ipp-a-fc0d65" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-fc0d65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-fc0d65-5657d46c4f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795-mf9jg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-fc0d65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795-mf9jg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-fc0d65-5657d46c4f-ql4x5

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fc0d65-5657d46c4f-ql4x5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fc0d65-5657d46c4f-ql4x5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fc0d65-5657d46c4f-ql4x5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795-mf9jg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795-mf9jg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-f1e791-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-f1e791-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-89d4a2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-89d4a2

openshift-ingress

deployment-controller

e2e-ipp-a-c40fc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5 from 0 to 1

openshift-ingress

deployment-controller

e2e-ipp-a-89d4a2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-89d4a2-openshift-default-6d779f946c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-89d4a2-openshift-default-6d779f946c

SuccessfulCreate

Created pod: e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd

openshift-ingress

replicaset-controller

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5

SuccessfulCreate

Created pod: e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c40fc3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c40fc3

openshift-ingress

multus

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-43fb1b-openshift-default-644c8cb85f-tzdfs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c40fc3: serviceaccount "payload-processing-e2e-ipp-a-c40fc3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575-mkpjp

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff-tt9qf

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c40fc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c40fc3: serviceaccount "payload-processing-e2e-ipp-a-c40fc3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c40fc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-f1e791-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575-mkpjp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575-mkpjp

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-f1e791-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575-mkpjp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575-mkpjp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff-tt9qf

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff-tt9qf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff-tt9qf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff-tt9qf

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7-98td5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-89d4a2: serviceaccount "payload-processing-e2e-ipp-a-89d4a2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-89d4a2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-89d4a2-654f669f45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-89d4a2-654f669f45

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-89d4a2-654f669f45-f4mvn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-89d4a2-654f669f45

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-89d4a2-654f669f45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-89d4a2: serviceaccount "payload-processing-e2e-ipp-a-89d4a2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-89d4a2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-89d4a2-654f669f45-f4mvn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7-98td5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-89d4a2-654f669f45-f4mvn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-89d4a2-654f669f45-f4mvn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-89d4a2-654f669f45-f4mvn

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7-98td5

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7-98td5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7-98td5

Started

Container started

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-9pvlc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-084d807f-openshift-default-84c8676869-zqhjh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-07afdd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-07afdd-openshift-default-6b44f5d885 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-07afdd-openshift-default-6b44f5d885

SuccessfulCreate

Created pod: e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

openshift-ingress

gateway_labeler_controller

e2e-api-a-07afdd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-07afdd

openshift-ingress

multus

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-07afdd-696875d767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-07afdd-696875d767-mll88

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-07afdd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-07afdd-7f68948dcf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-07afdd-7f68948dcf

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-07afdd-7f68948dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-07afdd: serviceaccount "payload-processing-e2e-api-a-07afdd" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-07afdd-696875d767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-07afdd-696875d767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-07afdd: serviceaccount "payload-processing-e2e-api-a-07afdd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-07afdd-7f68948dcf

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-07afdd-7f68948dcf-kspdn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-07afdd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-07afdd-696875d767 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-07afdd-696875d767-mll88

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-07afdd-696875d767-mll88

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-07afdd-696875d767-mll88

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-07afdd-7f68948dcf-kspdn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-07afdd-696875d767-mll88

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-07afdd-7f68948dcf-kspdn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-07afdd-7f68948dcf-kspdn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-07afdd-7f68948dcf-kspdn

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fc0d65-6f75b86795-mf9jg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fc0d65-5657d46c4f-ql4x5

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-d75c94-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d75c94-openshift-default-68bc89997 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-d75c94-openshift-default-68bc89997

SuccessfulCreate

Created pod: e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d75c94

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d75c94

openshift-ingress

multus

e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 10 to 7

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-4zj76

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-mht2p

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-rvcb2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-kb2gj

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-kb2gj

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kb2gj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulDelete

Deleted pod: e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d75c94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d75c94-6c8845777f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulDelete

Deleted pod: e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rvl96

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d75c94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-gms8c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulDelete

Deleted pod: e2e-worker-w2-c16684-openshift-default-77c759c989-rg6jk

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulDelete

Deleted pod: e2e-worker-w2-c16684-openshift-default-77c759c989-xkf9d

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kb2gj

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d75c94-6c8845777f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d75c94-6c8845777f-jdvq2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kb2gj

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5-k9bj7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d75c94: serviceaccount "payload-processing-e2e-ipp-b-d75c94" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d75c94-6c8845777f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d75c94-6c8845777f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d75c94: serviceaccount "payload-processing-e2e-ipp-b-d75c94" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kb2gj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.35s (3.35s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

Unhealthy

Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": read tcp 10.134.0.2:39948->10.134.0.85:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

ProbeError

Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": read tcp 10.134.0.2:39948->10.134.0.85:15021: read: connection reset by peer body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d75c94-6c8845777f-jdvq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d75c94-6c8845777f-jdvq2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5-k9bj7

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kb2gj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-processing-e2e-ipp-b-d75c94-6c8845777f-jdvq2

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d75c94-6c8845777f-jdvq2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5-k9bj7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5-k9bj7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kb2gj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5-k9bj7

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-c744c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-c744c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-h47qc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 10 to 7

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-k8mwh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-knt97

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-fc0d65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-fc0d65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-fc0d65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc0d65: serviceaccount "payload-processing-e2e-ipp-a-fc0d65" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-5bk4p
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-fc0d65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fc0d65: serviceaccount "payload-processing-e2e-ipp-a-fc0d65" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-ppvzt

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-5bk4p

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-ppvzt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-ppvzt

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-5bk4p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-ppvzt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.61s (1.61s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-5bk4p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.792s (1.792s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-ppvzt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-5bk4p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-ppvzt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-5bk4p

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

Unhealthy

Readiness probe failed: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

ProbeError

Readiness probe error: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c40fc3-584b94f575-mkpjp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c40fc3-5fb8bfbcff-tt9qf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-752623

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-752623

openshift-ingress

replicaset-controller

e2e-ipp-b-752623-openshift-default-f95fb57f9

SuccessfulCreate

Created pod: e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

openshift-ingress

deployment-controller

e2e-ipp-b-752623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-752623-openshift-default-f95fb57f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-89d4a2-654f669f45-f4mvn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-89d4a2-68bdd88d7-98td5

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-752623-85c7595ccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-752623-85c7595ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-752623: serviceaccount "payload-processing-e2e-ipp-b-752623" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-fc0d65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-fc0d65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-752623

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-752623-85c7595ccf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-752623-85c7595ccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-752623-85c7595ccf-jv2ls

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-752623

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-752623-57547865cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-752623-57547865cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-752623-57547865cc-lzn4w
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-752623-57547865cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-752623-57547865cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-752623: serviceaccount "payload-processing-e2e-ipp-b-752623" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-752623-57547865cc-lzn4w

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-752623-57547865cc-lzn4w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-752623-85c7595ccf-jv2ls

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-752623-85c7595ccf-jv2ls

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-752623-85c7595ccf-jv2ls

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-752623-85c7595ccf-jv2ls

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-752623-57547865cc-lzn4w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-752623-57547865cc-lzn4w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-89d4a2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-89d4a2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c40fc3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c40fc3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-c744c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-c744c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-5h64q

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-lvv4w

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 10 to 8

openshift-ingress

replicaset-controller

e2e-api-b-a3dae1-openshift-default-54785768d5

SuccessfulCreate

Created pod: e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q

openshift-ingress

gateway_labeler_controller

e2e-api-b-a3dae1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a3dae1

openshift-ingress

deployment-controller

e2e-api-b-a3dae1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a3dae1-openshift-default-54785768d5 from 0 to 1

openshift-ingress

multus

e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c40fc3-5dd57656d8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c40fc3-5dd57656d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c40fc3: serviceaccount "payload-processing-e2e-ipp-a-c40fc3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c40fc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c40fc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c40fc3-5dd57656d8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f-s7vvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-c40fc3-5dd57656d8-s2x4v

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c40fc3-5dd57656d8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c40fc3-5dd57656d8-s2x4v

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f-s7vvx

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f-s7vvx

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c40fc3: serviceaccount "payload-processing-e2e-ipp-a-c40fc3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f-s7vvx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c40fc3-5dd57656d8-s2x4v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f-s7vvx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c40fc3-5dd57656d8-s2x4v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c40fc3-5dd57656d8-s2x4v

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-89d4a2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-89d4a2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a3dae1-b68556cb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a3dae1-b68556cb7-nrmjs
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a3dae1-b68556cb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a3dae1-b68556cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a3dae1: serviceaccount "payload-processing-e2e-api-b-a3dae1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d-q8n2h

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5-6jkqk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a3dae1-ccf495dff

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a3dae1-ccf495dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a3dae1: serviceaccount "payload-processing-e2e-api-b-a3dae1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a3dae1-ccf495dff

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a3dae1-ccf495dff-kl5cj

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a3dae1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a3dae1-ccf495dff from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-89d4a2: serviceaccount "payload-processing-e2e-ipp-a-89d4a2" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-89d4a2: serviceaccount "payload-processing-e2e-ipp-a-89d4a2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a3dae1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a3dae1-b68556cb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5-6jkqk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-a3dae1-ccf495dff-kl5cj

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5-6jkqk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kwcbh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5-6jkqk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d-q8n2h

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d-q8n2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-a3dae1-ccf495dff-kl5cj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 10 to 7

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d-q8n2h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kbgkz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d-q8n2h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a3dae1-b68556cb7-nrmjs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a3dae1-b68556cb7-nrmjs

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-q5wrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a3dae1-b68556cb7-nrmjs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-a3dae1-ccf495dff-kl5cj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-a3dae1-ccf495dff-kl5cj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c40fc3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c40fc3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a3dae1-b68556cb7-nrmjs

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5-6jkqk

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-tqtn5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 8 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-82wwn

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d75c94-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d75c94-66664f4bf5-k9bj7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d75c94-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d75c94-6c8845777f-jdvq2

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c

SuccessfulCreate

Created pod: e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k

openshift-ingress

deployment-controller

e2e-ipp-b-9bbfc5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-9bbfc5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-9bbfc5

openshift-ingress

multus

e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-89d4a2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-89d4a2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-hf9ww

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9bbfc5-565fd984df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9bbfc5-565fd984df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9bbfc5: serviceaccount "payload-processing-e2e-ipp-b-9bbfc5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9bbfc5-565fd984df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9bbfc5-565fd984df-pmdxb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9bbfc5: serviceaccount "payload-processing-e2e-ipp-b-9bbfc5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c-kcqqn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9bbfc5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9bbfc5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9bbfc5-565fd984df from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c-kcqqn

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9bbfc5-565fd984df-pmdxb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9bbfc5-565fd984df-pmdxb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9bbfc5-565fd984df-pmdxb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-9bbfc5-565fd984df-pmdxb

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c-kcqqn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c-kcqqn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c-kcqqn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d75c94-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d75c94-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d75c94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d75c94-655fd7c9cb from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d75c94-655fd7c9cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d75c94-655fd7c9cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d75c94: serviceaccount "payload-processing-e2e-ipp-b-d75c94" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d75c94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c-ptvmb

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d75c94-655fd7c9cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d75c94-655fd7c9cb-4tcp8
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d75c94: serviceaccount "payload-processing-e2e-ipp-b-d75c94" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c-ptvmb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d75c94-655fd7c9cb-4tcp8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c-ptvmb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c-ptvmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c-ptvmb

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-d75c94-655fd7c9cb-4tcp8

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d75c94-655fd7c9cb-4tcp8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d75c94-655fd7c9cb-4tcp8

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

ProbeError

Readiness probe error: Get "http://10.132.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

Unhealthy

Readiness probe failed: Get "http://10.132.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-752623-85c7595ccf-jv2ls

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-752623-57547865cc-lzn4w

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-752623-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-752623-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-752623-b4dcbd679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-752623-b4dcbd679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-752623: serviceaccount "payload-processing-e2e-ipp-b-752623" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-752623-6bc5bf56b6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-752623-6bc5bf56b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-752623: serviceaccount "payload-processing-e2e-ipp-b-752623" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-752623

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-752623-6bc5bf56b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-752623-b4dcbd679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-752623-b4dcbd679-27pb6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-752623

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-752623-b4dcbd679 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-752623-6bc5bf56b6-pm4z4

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-752623-b4dcbd679-27pb6

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-752623-6bc5bf56b6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-752623-6bc5bf56b6-pm4z4

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-752623-b4dcbd679-27pb6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-752623-6bc5bf56b6-pm4z4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-752623-b4dcbd679-27pb6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-752623-b4dcbd679-27pb6

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-752623-6bc5bf56b6-pm4z4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-752623-6bc5bf56b6-pm4z4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-752623-6bc5bf56b6-pm4z4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.704s (1.704s including waiting). Image size: 166620835 bytes.
(x6)

openshift-ingress

kubelet

e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-07afdd-696875d767-mll88

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-07afdd-7f68948dcf-kspdn

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a3dae1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a3dae1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9bbfc5-b9bdbfb6c-kcqqn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9bbfc5-565fd984df-pmdxb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-07afdd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-07afdd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9bbfc5: serviceaccount "payload-processing-e2e-ipp-b-9bbfc5" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9bbfc5: serviceaccount "payload-processing-e2e-ipp-b-9bbfc5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9bbfc5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9bbfc5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd-t85fc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff-6kxwd

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd-t85fc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff-6kxwd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff-6kxwd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff-6kxwd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff-6kxwd

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd-t85fc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd-t85fc

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd-t85fc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-07afdd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9bbfc5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-07afdd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9bbfc5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-89d4a2-7b46f48b7d-q8n2h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-89d4a2-6d4b4fb4f5-6jkqk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-07afdd-openshift-default-6b44f5d885-r75td

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-89d4a2-openshift-default-6d779f946c-brfcd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a3dae1-b68556cb7-nrmjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a3dae1-ccf495dff-kl5cj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c40fc3-5dd57656d8-s2x4v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c40fc3-5c799cbb5f-s7vvx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-752623-b4dcbd679-27pb6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-752623-6bc5bf56b6-pm4z4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-c40fc3-openshift-default-fcbcf5cb5-7dm2z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-752623-openshift-default-f95fb57f9-njt2c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf

SuccessfulCreate

Created pod: e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-6d6576

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-6d6576

openshift-ingress

deployment-controller

e2e-praxis-a-6d6576-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf from 0 to 1

openshift-ingress

multus

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6d6576: serviceaccount "payload-processing-e2e-praxis-a-6d6576" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-6d6576

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-6d6576

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-6d6576-7b97b7b6c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6d6576-7b97b7b6c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-6d6576-7b97b7b6c-txn52
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6d6576-7b97b7b6c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-6d6576-7b97b7b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6d6576: serviceaccount "payload-processing-e2e-praxis-a-6d6576" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff-dg6gq

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff-dg6gq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff-dg6gq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6d6576-7b97b7b6c-txn52

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff-dg6gq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6d6576-7b97b7b6c-txn52

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-6d6576-7b97b7b6c-txn52

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6d6576-7b97b7b6c-txn52

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff-dg6gq

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-a3dae1-openshift-default-54785768d5-q8c9q

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d43b66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d43b66

openshift-ingress

replicaset-controller

e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9

SuccessfulCreate

Created pod: e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648

openshift-ingress

deployment-controller

e2e-ipp-a-d43b66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-1d8f7b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597

SuccessfulCreate

Created pod: e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-1d8f7b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-1d8f7b

openshift-ingress

multus

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d43b66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d43b66: serviceaccount "payload-processing-e2e-ipp-a-d43b66" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc-kq9j4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d43b66-774fc575ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d43b66-774fc575ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d43b66: serviceaccount "payload-processing-e2e-ipp-a-d43b66" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d43b66-774fc575ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d43b66-774fc575ff-zvlk8

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d43b66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d43b66-774fc575ff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d43b66-774fc575ff-zvlk8

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-d43b66-774fc575ff-zvlk8

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d43b66-774fc575ff-zvlk8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d43b66-774fc575ff-zvlk8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9bbfc5-6d947544ff-6kxwd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc-kq9j4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc-kq9j4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc-kq9j4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc-kq9j4

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9bbfc5-7b68fff8cd-t85fc

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1d8f7b: serviceaccount "payload-processing-e2e-praxis-a-1d8f7b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7-mnbgp

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc-654pk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1d8f7b: serviceaccount "payload-processing-e2e-praxis-a-1d8f7b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-1d8f7b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-1d8f7b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7-mnbgp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7-mnbgp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc-654pk

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7-mnbgp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc-654pk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc-654pk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc-654pk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7-mnbgp

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-9bbfc5-openshift-default-6bc8b6556c-qbt5k

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-80542b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-80542b-openshift-default-5f7fdb55bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf

SuccessfulCreate

Created pod: e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-80542b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-80542b

openshift-ingress

multus

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-80542b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-p4p27
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-80542b-6c5b644b9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-80542b-6c5b644b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-80542b: serviceaccount "payload-processing-e2e-praxis-a-80542b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-80542b: serviceaccount "payload-processing-e2e-praxis-a-80542b" not found

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-f9pgk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-cts4j

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-80542b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-80542b-6c5b644b9 from 0 to 1

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 10 to 8

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-p4p27

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-f9pgk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-80542b-6c5b644b9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-80542b-6c5b644b9-v8vqz

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-p4p27

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-p4p27

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cts4j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-p4p27

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-80542b-6c5b644b9-v8vqz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-80542b-6c5b644b9-v8vqz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-80542b-6c5b644b9-v8vqz

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-80542b-6c5b644b9-v8vqz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fc0d65-f9b755f5-5bk4p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fc0d65-6cd9b97bb-ppvzt

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-praxis-b-bb9990-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-bb9990

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-bb9990

openshift-ingress

replicaset-controller

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f

SuccessfulCreate

Created pod: e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

openshift-ingress

multus

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bb9990: serviceaccount "payload-processing-e2e-praxis-b-bb9990" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-bb9990

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-bb9990-644f4468f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bb9990-644f4468f9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-bb9990-644f4468f9-tvk5r
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bb9990-644f4468f9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-bb9990-644f4468f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bb9990: serviceaccount "payload-processing-e2e-praxis-b-bb9990" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c-8lc6x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-bb9990

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c-8lc6x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c-8lc6x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c-8lc6x

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c-8lc6x

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-bb9990-644f4468f9-tvk5r

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bb9990-644f4468f9-tvk5r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bb9990-644f4468f9-tvk5r

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-80542b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-80542b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bb9990-644f4468f9-tvk5r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d43b66-694bf987bc-kq9j4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d43b66-774fc575ff-zvlk8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

ProbeError

Readiness probe error: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

Unhealthy

Readiness probe failed: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d43b66-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d43b66-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-f4569e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f4569e

openshift-ingress

deployment-controller

e2e-praxis-b-f4569e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f4569e-openshift-default-544c6f5449 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-f4569e-openshift-default-544c6f5449

SuccessfulCreate

Created pod: e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6d6576-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6d6576-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1d8f7b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1d8f7b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc-jkc89
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f4569e: serviceaccount "payload-processing-e2e-praxis-b-f4569e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-f4569e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-f4569e-d74dfcc47 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-f4569e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f4569e-d74dfcc47

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-f4569e-d74dfcc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f4569e: serviceaccount "payload-processing-e2e-praxis-b-f4569e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f4569e-d74dfcc47

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-f4569e-d74dfcc47-qk226

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc-jkc89

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d43b66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d43b66-64664b7648 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc-jkc89

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f4569e-d74dfcc47-qk226

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f4569e-d74dfcc47-qk226

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f4569e-d74dfcc47-qk226

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-f4569e-d74dfcc47-qk226

AddedInterface

Add eth0 [10.132.0.198/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d43b66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc-jkc89

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc-jkc89

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95-2fgh6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d43b66: serviceaccount "payload-processing-e2e-ipp-a-d43b66" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95-2fgh6

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-9c8b33-openshift-default-798b6b79b9

SuccessfulCreate

Created pod: e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95-2fgh6

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d43b66-64664b7648

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d43b66-64664b7648-xk474
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d43b66-64664b7648

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d43b66-64664b7648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d43b66: serviceaccount "payload-processing-e2e-ipp-a-d43b66" not found

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-9c8b33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-9c8b33

openshift-ingress

deployment-controller

e2e-praxis-b-9c8b33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9c8b33-openshift-default-798b6b79b9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95-2fgh6

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-ckdqr

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-ipp-a-d43b66-64664b7648-xk474

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d43b66-64664b7648-xk474

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d43b66-64664b7648-xk474

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d43b66-64664b7648-xk474

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95-2fgh6

Started

Container started

openshift-ingress

multus

e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 7 to 5

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-tqnl9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 6 to 4

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9c8b33-59cdb566d5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-9c8b33-59cdb566d5-n8frp

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulDelete

Deleted pod: e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9c8b33-576597d459

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-9c8b33-576597d459-mq54c

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-sxhnf

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9c8b33-59cdb566d5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-9c8b33-59cdb566d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9c8b33: serviceaccount "payload-processing-e2e-praxis-b-9c8b33" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9c8b33-576597d459

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-9c8b33-576597d459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9c8b33: serviceaccount "payload-processing-e2e-praxis-b-9c8b33" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-9c8b33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-9c8b33-59cdb566d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-9c8b33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-9c8b33-576597d459 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulDelete

Deleted pod: e2e-worker-w2-c16684-openshift-default-77c759c989-l5ljc

openshift-ingress

multus

payload-processing-e2e-praxis-b-9c8b33-59cdb566d5-n8frp

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9c8b33-59cdb566d5-n8frp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9c8b33-59cdb566d5-n8frp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9c8b33-59cdb566d5-n8frp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-9c8b33-576597d459-mq54c

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9c8b33-576597d459-mq54c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9c8b33-576597d459-mq54c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9c8b33-576597d459-mq54c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-9qrn6

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-fc0d65-openshift-default-84f596955-qwqmr

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d43b66-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f4569e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d43b66-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f4569e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 6 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7

SuccessfulCreate

Created pod: e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

openshift-ingress

deployment-controller

e2e-ipp-b-09f39e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-09f39e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-09f39e
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1d8f7b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1d8f7b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tt659

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fr8nk

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-09f39e: serviceaccount "payload-processing-e2e-ipp-b-09f39e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-09f39e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-09f39e-ccff47f95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f-bmcdj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-09f39e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-bncsq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-bncsq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-09f39e-ccff47f95

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-09f39e-ccff47f95-b9rsw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-09f39e-ccff47f95

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-09f39e-ccff47f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-09f39e: serviceaccount "payload-processing-e2e-ipp-b-09f39e" not found

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 8 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-mnz78

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mnz78

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f-bmcdj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-09f39e-ccff47f95-b9rsw

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f-bmcdj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-09f39e-ccff47f95-b9rsw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-09f39e-ccff47f95-b9rsw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-09f39e-ccff47f95-b9rsw

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 6 to 5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f-bmcdj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f-bmcdj

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

ProbeError

Readiness probe error: Get "http://10.132.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

Unhealthy

Readiness probe failed: Get "http://10.132.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-x2llb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-80542b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-80542b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6d6576-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6d6576-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

ProbeError

Startup probe error: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

Unhealthy

Startup probe failed: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bb9990-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6d6576-7b97b7b6c-txn52

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6d6576-f4dc846ff-dg6gq

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bb9990-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-6xsgh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d75c94-655fd7c9cb-4tcp8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d75c94-5dc8c9458c-ptvmb

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-cqn85

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-np592

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 6 to 4

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bjtx4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-6d6576-openshift-default-6b8bdd8dbf-5q4qj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-d75c94-openshift-default-68bc89997-ksn28

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-praxis-a-448b01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-448b01-openshift-default-6d6ff966b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-448b01-openshift-default-6d6ff966b9

SuccessfulCreate

Created pod: e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-448b01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-448b01

openshift-ingress

multus

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-448b01-6778f95d9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-448b01-6778f95d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-448b01: serviceaccount "payload-processing-e2e-praxis-a-448b01" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-448b01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-448b01-67f46999c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-448b01-67f46999c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-448b01-67f46999c5-jlp47
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-448b01-67f46999c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-448b01-67f46999c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-448b01: serviceaccount "payload-processing-e2e-praxis-a-448b01" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-448b01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-448b01-6778f95d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-448b01-6778f95d9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-448b01-6778f95d9-mjvcz

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-448b01-6778f95d9-mjvcz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-448b01-67f46999c5-jlp47

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-448b01-67f46999c5-jlp47

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-448b01-67f46999c5-jlp47

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-448b01-6778f95d9-mjvcz

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-448b01-67f46999c5-jlp47

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-448b01-6778f95d9-mjvcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-448b01-6778f95d9-mjvcz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bb9990-644f4468f9-tvk5r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bb9990-7fdf9fc84c-8lc6x

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-94s77

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1d8f7b-8d6b4c9b7-mnbgp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1d8f7b-5b7c7fc8bc-654pk

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bb9990-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bb9990-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-4kglw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9c8b33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f4569e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9c8b33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f4569e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-09f39e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-09f39e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-kb2gj

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kb2gj

Killing

Stopping container discovery
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj

Unhealthy

Startup probe failed: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj

ProbeError

Startup probe error: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-bb9990-openshift-default-f5cbb8d6f-jqtjh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-09f39e-7c6d78d67f-bmcdj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-09f39e-ccff47f95-b9rsw

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-448b01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-448b01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-1d8f7b-openshift-default-7db6dd9597-rjkr9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-09f39e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-09f39e-796d44785b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-09f39e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-09f39e: serviceaccount "payload-processing-e2e-ipp-b-09f39e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875-8jrmp
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-09f39e-796d44785b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-09f39e-796d44785b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-09f39e: serviceaccount "payload-processing-e2e-ipp-b-09f39e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-09f39e-796d44785b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-09f39e-796d44785b-8w85c

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875-8jrmp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9c8b33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875-8jrmp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-09f39e-796d44785b-8w85c

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875-8jrmp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875-8jrmp

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-09f39e-796d44785b-8w85c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-09f39e-796d44785b-8w85c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-09f39e-796d44785b-8w85c

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9c8b33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-09f39e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-09f39e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f4569e-d74dfcc47-qk226

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f4569e-6dd47f74dc-jkc89

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-b-1f523a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-1f523a-openshift-default-6bf49b5765 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-1f523a-openshift-default-6bf49b5765

SuccessfulCreate

Created pod: e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-1f523a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-1f523a

openshift-ingress

multus

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-1f523a-867bb8df5c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-1f523a-867bb8df5c-szvlr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547-8vkdw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-1f523a: serviceaccount "payload-processing-e2e-praxis-b-1f523a" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-1f523a-867bb8df5c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-1f523a-867bb8df5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-1f523a: serviceaccount "payload-processing-e2e-praxis-b-1f523a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-1f523a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-1f523a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-1f523a-867bb8df5c from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547-8vkdw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547-8vkdw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1f523a-867bb8df5c-szvlr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1f523a-867bb8df5c-szvlr

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1f523a-867bb8df5c-szvlr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-1f523a-867bb8df5c-szvlr

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547-8vkdw

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547-8vkdw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 4 to 6

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d43b66-64664b7648-xk474

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d43b66-85b7687f95-2fgh6

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78

Started

Container started

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-f4569e-openshift-default-544c6f5449-cfxnc

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-d43b66-openshift-default-6b4c8f7cb9-n7648

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulCreate

Created pod: e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94

Created

Container created

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl

Unhealthy

Startup probe failed: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl

ProbeError

Startup probe error: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94

Unhealthy

Startup probe failed: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94

ProbeError

Startup probe error: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-448b01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-448b01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1f523a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1f523a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-09f39e-5d959cd875-8jrmp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-09f39e-796d44785b-8w85c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-448b01-6778f95d9-mjvcz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-448b01-67f46999c5-jlp47

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-09f39e-openshift-default-d7f9cc8c7-596fm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 3 to 6

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-b01ff6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-b01ff6

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69

SuccessfulCreate

Created pod: e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg

Started

Container started

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4

Started

Container started

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k

Started

Container started

openshift-ingress

multus

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-b01ff6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-p4p27

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-80542b-6c5b644b9-v8vqz

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1f523a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1f523a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-b01ff6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff-cxl4d
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b01ff6-7688d65785

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-b01ff6-7688d65785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b01ff6: serviceaccount "payload-processing-e2e-praxis-a-b01ff6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-b01ff6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-b01ff6-7688d65785 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b01ff6: serviceaccount "payload-processing-e2e-praxis-a-b01ff6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff-cxl4d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b01ff6-7688d65785-bgzkr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b01ff6-7688d65785-bgzkr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b01ff6-7688d65785-bgzkr

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b01ff6-7688d65785

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-b01ff6-7688d65785-bgzkr

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff-cxl4d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff-cxl4d

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff-cxl4d

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-b01ff6-7688d65785-bgzkr

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg

Unhealthy

Startup probe failed: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k

Unhealthy

Startup probe failed: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4

ProbeError

Startup probe error: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4

Unhealthy

Startup probe failed: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg

ProbeError

Startup probe error: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k

ProbeError

Startup probe error: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

Unhealthy

Startup probe failed: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

ProbeError

Startup probe error: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-80542b-777f94c5f9-p4p27

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-80542b-6c5b644b9-v8vqz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-448b01-openshift-default-6d6ff966b9-9xgns

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1f523a-867bb8df5c-szvlr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1f523a-f86c9c547-8vkdw

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulCreate

Created pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

ProbeError

Readiness probe error: Get "http://10.134.0.138:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

Unhealthy

Readiness probe failed: Get "http://10.134.0.138:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-praxis-b-1f523a-openshift-default-6bf49b5765-b9qcg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589

SuccessfulCreate

Created pod: e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

openshift-ingress

deployment-controller

e2e-praxis-b-ad121b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ad121b-openshift-default-5b4f9b9589 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ad121b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ad121b
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn

Unhealthy

Startup probe failed: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn

ProbeError

Startup probe error: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused body:

openshift-ingress

multus

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ad121b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ad121b-5c8c48fb87 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ad121b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

Unhealthy

Startup probe failed: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

ProbeError

Startup probe error: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad121b-5c8c48fb87

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ad121b-5c8c48fb87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad121b: serviceaccount "payload-processing-e2e-praxis-b-ad121b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad121b-5c8c48fb87

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ad121b-5c8c48fb87-m6zjl

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447-m9fhx

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447-m9fhx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447-m9fhx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447-m9fhx

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad121b: serviceaccount "payload-processing-e2e-praxis-b-ad121b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447-m9fhx

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad121b-5c8c48fb87-m6zjl

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-ad121b-5c8c48fb87-m6zjl

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad121b-5c8c48fb87-m6zjl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad121b-5c8c48fb87-m6zjl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b01ff6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b01ff6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-gmgjs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gmgjs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulDelete

Deleted pod: e2e-worker-w2-c16684-openshift-default-77c759c989-l7qzv

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-b36e62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5

SuccessfulCreate

Created pod: e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-b36e62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-b36e62

openshift-ingress

multus

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-80542b-openshift-default-5f7fdb55bf-nhfkk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-0877f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-0877f5

openshift-ingress

deployment-controller

e2e-shared-a-w0-0877f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-0877f5-openshift-default-65f9674c97 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97

SuccessfulCreate

Created pod: e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-b36e62-764477887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-b36e62: serviceaccount "payload-processing-e2e-shared-a-w1-b36e62" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-b36e62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-b36e62-5bb6746995 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-b36e62-5bb6746995

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-b36e62: serviceaccount "payload-processing-e2e-shared-a-w1-b36e62" not found

openshift-ingress

multus

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-b36e62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-b36e62-764477887 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-b36e62-764477887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-7prdg

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-v2lgh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-v2lgh

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-b36e62-5bb6746995

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-v2lgh

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-v2lgh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-7prdg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-v2lgh

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-7prdg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-7prdg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-7prdg

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b01ff6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b01ff6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-0877f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-0877f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-98ngt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-98ngt

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-0877f5: serviceaccount "payload-processing-e2e-shared-a-w0-0877f5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-98ngt

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-8t5wq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-0877f5: serviceaccount "payload-processing-e2e-shared-a-w0-0877f5" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-98ngt

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-98ngt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-8t5wq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-8t5wq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-8t5wq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-8t5wq

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9c8b33-59cdb566d5-n8frp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9c8b33-576597d459-mq54c

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-nq6b5

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b

openshift-ingress

kubelet

e2e-praxis-b-9c8b33-openshift-default-798b6b79b9-2ftxj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-6b5dab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-6b5dab

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55

Started

Container started

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55

AddedInterface

Add eth0 [10.132.0.225/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-6b5dab-openshift-default-684774b79f

SuccessfulCreate

Created pod: e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-a-w2-6b5dab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-6b5dab-openshift-default-684774b79f from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nq6b5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b01ff6-7d7ccdc8ff-cxl4d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b01ff6-7688d65785-bgzkr

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-6b5dab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-6b5dab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6b5dab: serviceaccount "payload-processing-e2e-shared-a-w2-6b5dab" not found
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z

Unhealthy

Startup probe failed: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55

Unhealthy

Startup probe failed: Get "http://10.132.0.225:15021/healthz/ready": dial tcp 10.132.0.225:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z

ProbeError

Startup probe error: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6b5dab: serviceaccount "payload-processing-e2e-shared-a-w2-6b5dab" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55

ProbeError

Startup probe error: Get "http://10.132.0.225:15021/healthz/ready": dial tcp 10.132.0.225:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-6ljcz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulCreate

Created pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r

openshift-ingress

multus

e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r

ProbeError

Startup probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r

Unhealthy

Startup probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-b-w1-fb32d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457

SuccessfulCreate

Created pod: e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-fb32d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-fb32d4

openshift-ingress

kubelet

e2e-praxis-a-b01ff6-openshift-default-5f7d9bdd69-6vgsf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf

SuccessfulCreate

Created pod: e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

openshift-ingress

deployment-controller

e2e-shared-b-w0-5237cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-5237cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-5237cd

openshift-ingress

multus

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-fb32d4: serviceaccount "payload-processing-e2e-shared-b-w1-fb32d4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-fp9xd

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-l6tzn

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-fb32d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-fb32d4: serviceaccount "payload-processing-e2e-shared-b-w1-fb32d4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-fb32d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-fp9xd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-fp9xd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-l6tzn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-l6tzn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-l6tzn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-l6tzn

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-fp9xd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-fp9xd

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad121b-7dcf49447-m9fhx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad121b-5c8c48fb87-m6zjl

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-5237cd: serviceaccount "payload-processing-e2e-shared-b-w0-5237cd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-5237cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-5237cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-5237cd: serviceaccount "payload-processing-e2e-shared-b-w0-5237cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-5fw8n

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-q7drz

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-q7drz

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-5fw8n

AddedInterface

Add eth0 [10.132.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-5fw8n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-5fw8n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-q7drz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-q7drz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-q7drz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-5fw8n

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

Unhealthy

Readiness probe failed: Get "http://10.134.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

ProbeError

Readiness probe error: Get "http://10.134.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

Unhealthy

Startup probe failed: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

ProbeError

Startup probe error: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad121b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad121b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b36e62-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b36e62-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w2-44405d-openshift-default-6447558b8c

SuccessfulCreate

Created pod: e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

openshift-ingress

deployment-controller

e2e-shared-b-w2-44405d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-44405d-openshift-default-6447558b8c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-44405d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-44405d

openshift-ingress

multus

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-29mnm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-44405d-855f4cf98f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-44405d: serviceaccount "payload-processing-e2e-shared-b-w2-44405d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-44405d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-44405d-855f4cf98f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-44405d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-44405d: serviceaccount "payload-processing-e2e-shared-b-w2-44405d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-44405d-855f4cf98f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-p874b

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-p874b

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-29mnm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-p874b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-29mnm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-29mnm

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-p874b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-29mnm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-p874b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-6b5dab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-6b5dab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b36e62-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b36e62-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-ad121b-openshift-default-5b4f9b9589-25s5p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

ProbeError

Readiness probe error: Get "http://10.134.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

Unhealthy

Readiness probe failed: Get "http://10.134.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-6b5dab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-6b5dab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

ProbeError

Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

Unhealthy

Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-explicit-efdee4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-efdee4-openshift-default-778dd4f665 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-efdee4-openshift-default-778dd4f665

SuccessfulCreate

Created pod: e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

openshift-ingress

gateway_labeler_controller

e2e-explicit-efdee4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-efdee4

openshift-ingress

multus

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulDelete

Deleted pod: e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-94gsm

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-efdee4-54d7b4cdff

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-efdee4-54d7b4cdff-2dr49

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-efdee4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-efdee4-54d7b4cdff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-efdee4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-efdee4-bf759994c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-efdee4-bf759994c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-efdee4-bf759994c-8q9gs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-efdee4-bf759994c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-efdee4-bf759994c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-efdee4: serviceaccount "payload-processing-e2e-explicit-efdee4" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-efdee4-54d7b4cdff

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-efdee4-54d7b4cdff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-efdee4: serviceaccount "payload-processing-e2e-explicit-efdee4" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-94gsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-efdee4-bf759994c-8q9gs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

payload-pre-processing-e2e-explicit-efdee4-bf759994c-8q9gs

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-efdee4-bf759994c-8q9gs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-j5gwc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-efdee4-bf759994c-8q9gs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-efdee4-54d7b4cdff-2dr49

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-efdee4-54d7b4cdff-2dr49

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-efdee4-54d7b4cdff-2dr49

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-efdee4-54d7b4cdff-2dr49

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

ProbeError

Readiness probe error: Get "http://10.134.0.163:15021/healthz/ready": read tcp 10.134.0.2:33028->10.134.0.163:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

Unhealthy

Readiness probe failed: Get "http://10.134.0.163:15021/healthz/ready": read tcp 10.134.0.2:33028->10.134.0.163:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

ProbeError

Startup probe error: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

Unhealthy

Startup probe failed: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5237cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5237cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulCreate

Created pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx

Created

Container created

openshift-ingress

multus

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

ProbeError

Readiness probe error: Get "http://10.133.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

Unhealthy

Readiness probe failed: Get "http://10.133.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx

Unhealthy

Startup probe failed: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj

Unhealthy

Startup probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx

ProbeError

Startup probe error: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj

ProbeError

Startup probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

Unhealthy

Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

ProbeError

Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-fb32d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-fb32d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

Unhealthy

Readiness probe failed: Get "http://10.134.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

ProbeError

Readiness probe error: Get "http://10.134.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

Unhealthy

Readiness probe failed: Get "http://10.133.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

ProbeError

Readiness probe error: Get "http://10.133.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5237cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5237cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-efdee4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-efdee4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-0877f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-0877f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-44405d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-44405d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-efdee4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-efdee4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-0877f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-0877f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-explicit-efdee4-54d7b4cdff-2dr49

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-efdee4-bf759994c-8q9gs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-efdee4-openshift-default-778dd4f665-dxlxp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-d7fd1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-d7fd1a-openshift-default-77f6fb6659 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-d7fd1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-d7fd1a

openshift-ingress

multus

e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-d7fd1a-openshift-default-77f6fb6659

SuccessfulCreate

Created pod: e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x

openshift-ingress

kubelet

e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x

Started

Container started

openshift-ingress

kubelet

e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-d7fd1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-d7fd1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-d7fd1a-openshift-default-77f6fb6659-4mx2x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

opendatahub

kubelet

test-curl-7552-30c4ba

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7552-30c4ba

Created

Container created

opendatahub

kubelet

test-curl-7552-30c4ba

Started

Container started

opendatahub

multus

test-curl-7552-30c4ba

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7552-30c4ba

Killing

Stopping container test-curl-7552-30c4ba

opendatahub

multus

test-curl-7552-8bb9b0

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7552-8bb9b0

Started

Container started

opendatahub

kubelet

test-curl-7552-8bb9b0

Created

Container created

opendatahub

kubelet

test-curl-7552-8bb9b0

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7552-4ccea5

Started

Container started

opendatahub

multus

test-curl-7552-4ccea5

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7552-8bb9b0

Killing

Stopping container test-curl-7552-8bb9b0

opendatahub

kubelet

test-curl-7552-4ccea5

Created

Container created

opendatahub

kubelet

test-curl-7552-4ccea5

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7552-c259b0

Created

Container created

opendatahub

kubelet

test-curl-7552-c259b0

Started

Container started

opendatahub

multus

test-curl-7552-c259b0

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7552-c259b0

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7552-4ccea5

Killing

Stopping container test-curl-7552-4ccea5

opendatahub

kubelet

test-curl-7552-fd65ec

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7552-c259b0

Killing

Stopping container test-curl-7552-c259b0

opendatahub

multus

test-curl-7552-fd65ec

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7552-fd65ec

Created

Container created

opendatahub

kubelet

test-curl-7552-fd65ec

Started

Container started

opendatahub

kubelet

test-curl-7552-fd65ec

Killing

Stopping container test-curl-7552-fd65ec

openshift-ingress

replicaset-controller

e2e-extmod-a-4bd51b-openshift-default-b8544dc4f

SuccessfulCreate

Created pod: e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8

openshift-ingress

deployment-controller

e2e-extmod-a-4bd51b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-4bd51b-openshift-default-b8544dc4f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-4bd51b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-4bd51b

openshift-ingress

multus

e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-4bd51b: serviceaccount "payload-processing-e2e-extmod-a-4bd51b" not found

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-4bd51b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-4bd51b-7d76c5559f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-4bd51b-7d76c5559f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-4bd51b: serviceaccount "payload-processing-e2e-extmod-a-4bd51b" not found

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hp95g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-ld82r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-4bd51b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-qcplm

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-l6flm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-4bd51b-7d76c5559f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-r978k

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-ld82r

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-ld82r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-r978k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-r978k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-r978k

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-r978k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-ld82r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-ld82r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-k7cm7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-943963

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-943963

openshift-ingress

replicaset-controller

e2e-extmod-a-943963-openshift-default-68fddd7bb5

SuccessfulCreate

Created pod: e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

openshift-ingress

deployment-controller

e2e-extmod-a-943963-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-943963-openshift-default-68fddd7bb5 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-943963

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-943963-7568c9dd8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-943963-688574d587

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-943963-688574d587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-943963: serviceaccount "payload-processing-e2e-extmod-a-943963" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-943963-7568c9dd8c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-943963-7568c9dd8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-943963: serviceaccount "payload-processing-e2e-extmod-a-943963" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-943963-688574d587-7wwhp

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-943963-688574d587-7wwhp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-943963-688574d587-7wwhp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-943963-688574d587-7wwhp

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-943963-7568c9dd8c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-943963-7568c9dd8c-99fk7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-943963-688574d587

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-943963-688574d587-7wwhp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-943963

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-943963-688574d587 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-943963-7568c9dd8c-99fk7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-943963-7568c9dd8c-99fk7

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-943963-7568c9dd8c-99fk7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-943963-7568c9dd8c-99fk7

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4bd51b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4bd51b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xspc2

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-zhsnl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-xvl7k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-bkzzl

openshift-ingress

replicaset-controller

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765

SuccessfulCreate

Created pod: e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

openshift-ingress

deployment-controller

e2e-extmod-b-c34cbd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-c34cbd-openshift-default-76b9b8b765 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-c34cbd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-c34cbd

openshift-ingress

multus

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-v5wpt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-c34cbd: serviceaccount "payload-processing-e2e-extmod-b-c34cbd" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-c34cbd-559d4ccccf

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-c34cbd: serviceaccount "payload-processing-e2e-extmod-b-c34cbd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-c34cbd-559d4ccccf

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-bxss4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-c34cbd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-c34cbd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-c34cbd-559d4ccccf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-v5wpt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-bxss4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-v5wpt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-bxss4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-v5wpt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-v5wpt

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-bxss4

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-bxss4

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8

Unhealthy

Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8

ProbeError

Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body:

opendatahub

multus

test-curl-7546-35d504

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7546-35d504

Started

Container started

opendatahub

kubelet

test-curl-7546-35d504

Created

Container created

opendatahub

kubelet

test-curl-7546-35d504

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7546-35d504

Killing

Stopping container test-curl-7546-35d504

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-56a6d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-56a6d4

openshift-ingress

multus

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69

SuccessfulCreate

Created pod: e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

openshift-ingress

deployment-controller

e2e-extmod-b-56a6d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-56a6d4-openshift-default-75f8d9db69 from 0 to 1

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

ProbeError

Readiness probe error: Get "http://10.133.0.160:15021/healthz/ready": read tcp 10.133.0.2:52624->10.133.0.160:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

Unhealthy

Readiness probe failed: Get "http://10.133.0.160:15021/healthz/ready": read tcp 10.133.0.2:52624->10.133.0.160:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-56a6d4: serviceaccount "payload-processing-e2e-extmod-b-56a6d4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-56a6d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-2jddx

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-56a6d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-56a6d4-6758676965 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-56a6d4-6758676965

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-56a6d4-6758676965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-56a6d4: serviceaccount "payload-processing-e2e-extmod-b-56a6d4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-56a6d4-6758676965

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-56a6d4-6758676965-4l9dm

openshift-ingress

multus

payload-processing-e2e-extmod-b-56a6d4-6758676965-4l9dm

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56a6d4-6758676965-4l9dm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-2jddx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56a6d4-6758676965-4l9dm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-2jddx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-2jddx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-2jddx

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56a6d4-6758676965-4l9dm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-ckh7r
(x5)

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-zt98z
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4bd51b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4bd51b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w2-44405d-openshift-default-6447558b8c

SuccessfulCreate

Created pod: e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

openshift-ingress

deployment-controller

e2e-shared-b-w2-44405d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-44405d-openshift-default-6447558b8c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-44405d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-2rnbl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

Created

Container created

openshift-ingress

multus

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-696f9a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-696f9a

openshift-ingress

deployment-controller

e2e-extmod-a-696f9a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-696f9a-openshift-default-65db49bc97 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-4499m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-696f9a-openshift-default-65db49bc97

SuccessfulCreate

Created pod: e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-thq55

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-njj9b

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-696f9a: serviceaccount "payload-processing-e2e-extmod-a-696f9a" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-696f9a-67f544df69

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-696f9a-67f544df69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-696f9a: serviceaccount "payload-processing-e2e-extmod-a-696f9a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-696f9a-67f544df69

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-696f9a-67f544df69-gb7nm

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-696f9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-696f9a-67f544df69 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-pnrxl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-696f9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696f9a-67f544df69-gb7nm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-pnrxl

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-943963-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-943963-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696f9a-67f544df69-gb7nm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696f9a-67f544df69-gb7nm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-696f9a-67f544df69-gb7nm

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-pnrxl

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-pnrxl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-pnrxl

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-56a6d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-56a6d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 5 to 4

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-6nw78

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-c16684-openshift-default-77c759c989

SuccessfulDelete

Deleted pod: e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-c16684-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-c16684-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-c16684-openshift-default-77c759c989 from 2 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-294zx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 3 to 2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-294zx

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-wrm6q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-autores-f1128d-openshift-default-7b78c96947

SuccessfulCreate

Created pod: e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

openshift-ingress

deployment-controller

e2e-autores-f1128d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-f1128d-openshift-default-7b78c96947 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-f1128d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-f1128d

openshift-ingress

multus

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

ProbeError

Readiness probe error: Get "http://10.134.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

Unhealthy

Readiness probe failed: Get "http://10.134.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f1128d-575cff74f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-f1128d-575cff74f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f1128d: serviceaccount "payload-processing-e2e-autores-f1128d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-f1128d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-f1128d-575cff74f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f1128d-666bb85d4f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-f1128d-666bb85d4f-nstgl

openshift-ingress

deployment-controller

payload-processing-e2e-autores-f1128d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-f1128d-666bb85d4f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f1128d-666bb85d4f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-f1128d-666bb85d4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f1128d: serviceaccount "payload-processing-e2e-autores-f1128d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f1128d-575cff74f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-f1128d-575cff74f5-j7hbl

openshift-ingress

multus

payload-pre-processing-e2e-autores-f1128d-575cff74f5-j7hbl

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f1128d-575cff74f5-j7hbl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-autores-f1128d-666bb85d4f-nstgl

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-f1128d-666bb85d4f-nstgl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-f1128d-666bb85d4f-nstgl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f1128d-575cff74f5-j7hbl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f1128d-575cff74f5-j7hbl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-f1128d-666bb85d4f-nstgl

Created

Container created
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg
(x5)

openshift-ingress

kubelet

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

Unhealthy

Startup probe failed: Get "http://10.134.0.178:15021/healthz/ready": dial tcp 10.134.0.178:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

(combined from similar events): New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-5t6hg

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

ProbeError

Startup probe error: Get "http://10.134.0.178:15021/healthz/ready": dial tcp 10.134.0.178:15021: connect: connection refused body:
(x5)

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 5 to 4

openshift-ingress

deployment-controller

e2e-shared-b-w2-44405d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-44405d-openshift-default-6447558b8c from 2 to 3

opendatahub

kubelet

test-curl-7540-79de5a

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-b-w2-44405d-openshift-default-6447558b8c

SuccessfulCreate

Created pod: e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-tvjtx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-44405d-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

opendatahub

multus

test-curl-7540-79de5a

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7540-79de5a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7540-79de5a

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

Unhealthy

Readiness probe failed: Get "http://10.134.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

ProbeError

Readiness probe error: Get "http://10.134.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97

SuccessfulCreate

Created pod: e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94
(x2)

openshift-ingress

kubelet

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7540-79de5a

Killing

Stopping container test-curl-7540-79de5a

openshift-ingress

multus

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-0877f5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w0-0877f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-0877f5-openshift-default-65f9674c97 from 1 to 2
(x2)

openshift-ingress

kubelet

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94

Started

Container started

openshift-ingress

multus

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-fac043

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-fac043

openshift-ingress

deployment-controller

e2e-extmod-a-fac043-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-fac043-openshift-default-7bc677c6b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-fac043-openshift-default-7bc677c6b9

SuccessfulCreate

Created pod: e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

Unhealthy

Startup probe failed: Get "http://10.132.0.242:15021/healthz/ready": dial tcp 10.132.0.242:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

ProbeError

Startup probe error: Get "http://10.132.0.242:15021/healthz/ready": dial tcp 10.132.0.242:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-fac043: serviceaccount "payload-processing-e2e-extmod-a-fac043" not found
(x6)

openshift-ingress

kubelet

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

ProbeError

Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-fac043-7f5bf697

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-fac043-7f5bf697-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-fac043: serviceaccount "payload-processing-e2e-extmod-a-fac043" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-shkg8
(x6)

openshift-ingress

kubelet

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

Unhealthy

Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-fac043-7f5bf697

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-fac043-7f5bf697-vrxkn

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-fac043

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-fac043-7f5bf697 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-fac043

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-extmod-a-fac043-7f5bf697-vrxkn

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-shkg8

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c34cbd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-fac043-7f5bf697-vrxkn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c34cbd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-fac043-7f5bf697-vrxkn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-fac043-7f5bf697-vrxkn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-shkg8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-shkg8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-shkg8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-696f9a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-696f9a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-4a73b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-4a73b1

openshift-ingress

deployment-controller

e2e-extmod-b-4a73b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-4a73b1-openshift-default-5d7947885 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-4a73b1-openshift-default-5d7947885

SuccessfulCreate

Created pod: e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j

openshift-ingress

multus

e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb

Unhealthy

Startup probe failed: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb

ProbeError

Startup probe error: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-4a73b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-4a73b1-77b884cb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-4a73b1-77b884cb9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-4a73b1-77b884cb9-g55qb
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-56a6d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-j9ws8
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-56a6d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-4a73b1: serviceaccount "payload-processing-e2e-extmod-b-4a73b1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-j9ws8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-j9ws8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-j9ws8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-j9ws8

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-4a73b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-4a73b1-77b884cb9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-4a73b1-77b884cb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-4a73b1: serviceaccount "payload-processing-e2e-extmod-b-4a73b1" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-4a73b1-77b884cb9-g55qb

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a73b1-77b884cb9-g55qb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a73b1-77b884cb9-g55qb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a73b1-77b884cb9-g55qb

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-b-w0-5237cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5237cd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf

SuccessfulCreate

Created pod: e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

Created

Container created

openshift-ingress

multus

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-f1128d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-f1128d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fac043-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fac043-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-696f9a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-696f9a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

Unhealthy

Startup probe failed: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

ProbeError

Startup probe error: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f

SuccessfulCreate

Created pod: e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-2dbae9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-2dbae9

openshift-ingress

deployment-controller

e2e-extmod-b-2dbae9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2dbae9-openshift-default-7d88757d4f from 0 to 1

openshift-ingress

multus

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-f1128d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-f1128d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79-wjpd6

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-2dbae9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2dbae9: serviceaccount "payload-processing-e2e-extmod-b-2dbae9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-2dbae9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867-7qlsd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2dbae9: serviceaccount "payload-processing-e2e-extmod-b-2dbae9" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79-wjpd6

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867-7qlsd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79-wjpd6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867-7qlsd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867-7qlsd

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79-wjpd6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79-wjpd6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867-7qlsd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2dbae9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2dbae9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-autores-f1128d-666bb85d4f-nstgl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f1128d-575cff74f5-j7hbl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-xjb94

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fac043-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fac043-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 4 to 3
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mkgb4

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j

ProbeError

Startup probe error: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j

Unhealthy

Startup probe failed: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4a73b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4a73b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-4275b9-openshift-default-67d67b45c

SuccessfulCreate

Created pod: e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

openshift-ingress

deployment-controller

e2e-extmod-a-4275b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-4275b9-openshift-default-67d67b45c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-4275b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-4275b9

openshift-ingress

multus

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

ProbeError

Readiness probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-f1128d-openshift-default-7b78c96947-j7fmc

Unhealthy

Readiness probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-4275b9-67997cc74f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-4275b9-67997cc74f-twxgh

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-4275b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-4275b9-67997cc74f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-4275b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-w497b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-w497b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-4275b9: serviceaccount "payload-processing-e2e-extmod-a-4275b9" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-4275b9-67997cc74f-twxgh

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-w497b

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-4275b9-67997cc74f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-4275b9-67997cc74f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-4275b9: serviceaccount "payload-processing-e2e-extmod-a-4275b9" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4275b9-67997cc74f-twxgh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4275b9-67997cc74f-twxgh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-w497b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-w497b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4275b9-67997cc74f-twxgh

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

Unhealthy

Readiness probe failed: Get "http://10.134.0.201:15021/healthz/ready": read tcp 10.134.0.2:52518->10.134.0.201:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

ProbeError

Readiness probe error: Get "http://10.134.0.201:15021/healthz/ready": read tcp 10.134.0.2:52518->10.134.0.201:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

ProbeError

Startup probe error: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

Unhealthy

Startup probe failed: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2dbae9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2dbae9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

ProbeError

Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

Unhealthy

Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4275b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4275b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-a5affe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a5affe-openshift-default-dd9b47fd9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-a5affe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-a5affe

openshift-ingress

replicaset-controller

e2e-extmod-b-a5affe-openshift-default-dd9b47fd9

SuccessfulCreate

Created pod: e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd

openshift-ingress

multus

e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-a5affe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-a5affe-78c59c567 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-a5affe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-a5affe-86cc9766b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a5affe-78c59c567

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-c6hdt

openshift-ingress

multus

payload-processing-e2e-extmod-b-a5affe-86cc9766b5-278sw

AddedInterface

Add eth0 [10.132.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-c6hdt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-c6hdt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-c6hdt

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a5affe-86cc9766b5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-a5affe-86cc9766b5-278sw

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-c6hdt

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a5affe-86cc9766b5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-a5affe-86cc9766b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a5affe: serviceaccount "payload-processing-e2e-extmod-b-a5affe" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a5affe-78c59c567

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a5affe: serviceaccount "payload-processing-e2e-extmod-b-a5affe" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a5affe-86cc9766b5-278sw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a5affe-86cc9766b5-278sw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a5affe-86cc9766b5-278sw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m
(x7)

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4275b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-4275b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-zrd7m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a5affe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a5affe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-v8swj
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-44405d-openshift-default-6447558b8c

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-44405d-openshift-default-6447558b8c-hqcwp

openshift-ingress

deployment-controller

e2e-shared-b-w2-44405d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-44405d-openshift-default-6447558b8c from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-44405d-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

deployment-controller

e2e-worker-w0-4b5989-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-4b5989-openshift-default-578774676c from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4b5989-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x5)

openshift-ingress

replicaset-controller

e2e-worker-w0-4b5989-openshift-default-578774676c

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-0877f5-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94

openshift-ingress

deployment-controller

e2e-shared-a-w0-0877f5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-0877f5-openshift-default-65f9674c97 from 2 to 1

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-65s94

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-gxf48

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd

ProbeError

Startup probe error: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd

Unhealthy

Startup probe failed: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-a-fac043-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-fac043-openshift-default-7bc677c6b9 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fac043-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-fac043-openshift-default-7bc677c6b9

SuccessfulCreate

Created pod: e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

Unhealthy

Startup probe failed: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

ProbeError

Startup probe error: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a5affe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a5affe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t
(x3)

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-fsm7t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-75fdc85848

FailedCreate

Error creating: pods "payload-processing-external-model-75fdc85848-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-75fdc85848 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-75fdc85848

SuccessfulCreate

Created pod: payload-processing-external-model-75fdc85848-47q46

models-as-a-service

kubelet

payload-processing-external-model-75fdc85848-47q46

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-75fdc85848-47q46

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-75fdc85848-47q46

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-75fdc85848-47q46

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes

models-as-a-service

multus

payload-processing-external-model-67ddf5bb68-5ss2r

AddedInterface

Add eth0 [10.134.0.252/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-67ddf5bb68 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-67ddf5bb68

SuccessfulCreate

Created pod: payload-processing-external-model-67ddf5bb68-5ss2r

models-as-a-service

kubelet

payload-processing-external-model-67ddf5bb68-5ss2r

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-67ddf5bb68-5ss2r

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-67ddf5bb68-5ss2r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-75fdc85848

SuccessfulDelete

Deleted pod: payload-processing-external-model-75fdc85848-47q46

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-75fdc85848 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-75fdc85848-47q46

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-vxrb9

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 2 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-vnvpp

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

Unhealthy

Startup probe failed: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

Unhealthy

Startup probe failed: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

ProbeError

Startup probe error: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

ProbeError

Startup probe error: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused body:

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-gjgbb

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 4 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-5drlf

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-5drlf

AddedInterface

Add eth0 [10.134.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5drlf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5drlf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5drlf

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

ProbeError

Startup probe error: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

Unhealthy

Startup probe failed: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5drlf

ProbeError

Startup probe error: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5drlf

Unhealthy

Startup probe failed: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-96tvd

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 6 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-b659t

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-btqnt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-kf6vz

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-96tvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-96tvd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b659t

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-btqnt

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-btqnt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-btqnt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-btqnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b659t

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b659t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-b659t

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-96tvd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-96tvd

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

AddedInterface

Add eth0 [10.134.1.0/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-btqnt

Unhealthy

Startup probe failed: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b659t

ProbeError

Startup probe error: Get "http://10.133.0.205:15021/healthz/ready": dial tcp 10.133.0.205:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-btqnt

ProbeError

Startup probe error: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

ProbeError

Startup probe error: Get "http://10.134.1.0:15021/healthz/ready": dial tcp 10.134.1.0:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-96tvd

ProbeError

Startup probe error: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-96tvd

Unhealthy

Startup probe failed: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b659t

Unhealthy

Startup probe failed: Get "http://10.133.0.205:15021/healthz/ready": dial tcp 10.133.0.205:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

Unhealthy

Startup probe failed: Get "http://10.134.1.0:15021/healthz/ready": dial tcp 10.134.1.0:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-5fb7f7d54b

SuccessfulCreate

Created pod: payload-processing-external-model-5fb7f7d54b-mfmxn

models-as-a-service

multus

payload-processing-external-model-5fb7f7d54b-mfmxn

AddedInterface

Add eth0 [10.134.1.1/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5fb7f7d54b-mfmxn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5fb7f7d54b-mfmxn

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5fb7f7d54b-mfmxn

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5fb7f7d54b-mfmxn

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-5fb7f7d54b

SuccessfulDelete

Deleted pod: payload-processing-external-model-5fb7f7d54b-mfmxn
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5fb7f7d54b from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5fb7f7d54b

SuccessfulCreate

Created pod: payload-processing-external-model-5fb7f7d54b-fkfs7

models-as-a-service

kubelet

payload-processing-external-model-5fb7f7d54b-fkfs7

Created

Container created

models-as-a-service

multus

payload-processing-external-model-5fb7f7d54b-fkfs7

AddedInterface

Add eth0 [10.134.1.3/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5fb7f7d54b-fkfs7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5fb7f7d54b-fkfs7

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-5fb7f7d54b

SuccessfulDelete

Deleted pod: payload-processing-external-model-5fb7f7d54b-fkfs7
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5fb7f7d54b from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-5fb7f7d54b-fkfs7

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-86bc8645b9-btzdb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-86bc8645b9 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-86bc8645b9-btzdb

AddedInterface

Add eth0 [10.134.1.5/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-86bc8645b9

SuccessfulCreate

Created pod: payload-processing-external-model-86bc8645b9-btzdb

models-as-a-service

kubelet

payload-processing-external-model-86bc8645b9-btzdb

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-86bc8645b9-btzdb

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-86bc8645b9-btzdb

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-86bc8645b9

SuccessfulDelete

Deleted pod: payload-processing-external-model-86bc8645b9-btzdb

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-86bc8645b9 from 1 to 0

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7qkl

Unhealthy

Readiness probe failed: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7qkl

ProbeError

Readiness probe error: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-58cdbd54fd-wbdtq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-58cdbd54fd-wbdtq

AddedInterface

Add eth0 [10.134.1.10/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-58cdbd54fd

SuccessfulCreate

Created pod: payload-processing-external-model-58cdbd54fd-wbdtq

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-58cdbd54fd from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-58cdbd54fd-wbdtq

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-58cdbd54fd-wbdtq

Created

Container created
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-hcd5s

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-67ddf5bb68

SuccessfulDelete

Deleted pod: payload-processing-external-model-67ddf5bb68-5ss2r

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-67ddf5bb68 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-67ddf5bb68-5ss2r

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w2-44405d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-44405d-openshift-default-6447558b8c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-44405d-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-44405d-openshift-default-6447558b8c

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-pq6gm

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-4pkc6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

models-as-a-service

replicaset-controller

payload-processing-external-model-54fc546546

SuccessfulCreate

Created pod: payload-processing-external-model-54fc546546-rdlkm

models-as-a-service

kubelet

payload-processing-external-model-54fc546546-rdlkm

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-54fc546546-rdlkm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-54fc546546-rdlkm

AddedInterface

Add eth0 [10.134.1.22/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-54fc546546-rdlkm

Started

Container started

openshift-ingress

deployment-controller

e2e-inf-a-710927-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-710927-openshift-default-6b78cf7667 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-710927

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-710927

openshift-ingress

replicaset-controller

e2e-inf-a-710927-openshift-default-6b78cf7667

SuccessfulCreate

Created pod: e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs

openshift-ingress

multus

e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-710927

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-710927-7859f7d845 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-710927-5bdd596d55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-710927-5bdd596d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-710927: serviceaccount "payload-processing-e2e-inf-a-710927" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-710927-5bdd596d55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-710927-5bdd596d55-2t8rq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-710927-7859f7d845

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-710927-7859f7d845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-710927: serviceaccount "payload-processing-e2e-inf-a-710927" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-710927

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-710927-5bdd596d55 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-710927-7859f7d845-ht9pt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-710927-5bdd596d55-2t8rq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-710927-5bdd596d55-2t8rq

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-710927-7859f7d845-ht9pt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-710927-7859f7d845-ht9pt

AddedInterface

Add eth0 [10.134.1.23/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-710927-7859f7d845

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-710927-7859f7d845-ht9pt

openshift-ingress

kubelet

payload-processing-e2e-inf-a-710927-7859f7d845-ht9pt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-710927-5bdd596d55-2t8rq

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-fac043-openshift-default-7bc677c6b9

SuccessfulDelete

Deleted pod: e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-qtslh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-710927-5bdd596d55-2t8rq

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fac043-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-fac043-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-fac043-openshift-default-7bc677c6b9 from 2 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-58cdbd54fd

SuccessfulDelete

Deleted pod: payload-processing-external-model-58cdbd54fd-wbdtq

models-as-a-service

kubelet

payload-processing-external-model-58cdbd54fd-wbdtq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5drlf

Unhealthy

Readiness probe failed: Get "http://10.134.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

ProbeError

Readiness probe error: Get "http://10.134.1.0:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5drlf

ProbeError

Readiness probe error: Get "http://10.134.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

Unhealthy

Readiness probe failed: Get "http://10.134.1.0:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-710927-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-710927-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-a-cd421c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-cd421c

openshift-ingress

deployment-controller

e2e-inf-a-cd421c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-cd421c-openshift-default-5b7f98b7b5 from 0 to 1

openshift-ingress

multus

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5

SuccessfulCreate

Created pod: e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

models-as-a-service

replicaset-controller

payload-processing-external-model-7f548df5c7

SuccessfulCreate

Created pod: payload-processing-external-model-7f548df5c7-g5nft

models-as-a-service

multus

payload-processing-external-model-7f548df5c7-g5nft

AddedInterface

Add eth0 [10.134.1.31/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7f548df5c7-g5nft

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7f548df5c7-g5nft

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7f548df5c7-g5nft

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-cd421c-6884df5c6c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-cd421c-6884df5c6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-cd421c: serviceaccount "payload-processing-e2e-inf-a-cd421c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-cd421c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-cd421c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-cd421c-6884df5c6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-8hf7s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-cd421c: serviceaccount "payload-processing-e2e-inf-a-cd421c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cd421c-6884df5c6c-ns6q6

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-cd421c-6884df5c6c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-cd421c-6884df5c6c-ns6q6

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-8hf7s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-8hf7s

AddedInterface

Add eth0 [10.134.1.33/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-cd421c-6884df5c6c-ns6q6

AddedInterface

Add eth0 [10.134.1.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cd421c-6884df5c6c-ns6q6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cd421c-6884df5c6c-ns6q6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-8hf7s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-8hf7s

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-a-943963-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-943963-openshift-default-68fddd7bb5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-a-943963-openshift-default-68fddd7bb5

SuccessfulCreate

Created pod: e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

openshift-ingress

replicaset-controller

e2e-inf-b-c2d1b8-openshift-default-584f96b4df

SuccessfulCreate

Created pod: e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-943963-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-c2d1b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c2d1b8-openshift-default-584f96b4df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c2d1b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c2d1b8

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

AddedInterface

Add eth0 [10.134.1.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c2d1b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c2d1b8-79c64d499f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c2d1b8-79c64d499f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c2d1b8-79c64d499f-fd4zx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-s9xgp
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c2d1b8: serviceaccount "payload-processing-e2e-inf-b-c2d1b8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c2d1b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c2d1b8-79c64d499f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c2d1b8-79c64d499f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c2d1b8: serviceaccount "payload-processing-e2e-inf-b-c2d1b8" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-c2d1b8-79c64d499f-fd4zx

AddedInterface

Add eth0 [10.134.1.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c2d1b8-79c64d499f-fd4zx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-s9xgp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c2d1b8-79c64d499f-fd4zx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-s9xgp

AddedInterface

Add eth0 [10.134.1.37/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

ProbeError

Startup probe error: Get "http://10.134.1.35:15021/healthz/ready": dial tcp 10.134.1.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

Unhealthy

Startup probe failed: Get "http://10.134.1.35:15021/healthz/ready": dial tcp 10.134.1.35:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-s9xgp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c2d1b8-79c64d499f-fd4zx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-s9xgp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-fac043-7f5bf697-vrxkn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-shkg8

Killing

Stopping container payload-pre-processing

models-as-a-service

kubelet

payload-processing-external-model-54fc546546-rdlkm

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-54fc546546

SuccessfulDelete

Deleted pod: payload-processing-external-model-54fc546546-rdlkm
(x4)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled down replica set payload-processing-external-model-54fc546546 from 1 to 0
(x2)

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

Unhealthy

Readiness probe failed: Get "http://10.132.0.251:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

Unhealthy

Readiness probe failed: Get "http://10.133.0.204:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

ProbeError

Readiness probe error: Get "http://10.132.0.251:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

Unhealthy

Liveness probe failed: Get "https://10.133.0.36:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-btqnt

ProbeError

Readiness probe error: Get "http://10.132.0.253:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-btqnt

Unhealthy

Readiness probe failed: Get "http://10.132.0.253:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

ProbeError

Readiness probe error: Get "http://10.133.0.204:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

ProbeError

Readiness probe error: Get "http://10.132.0.252:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

Unhealthy

Readiness probe failed: Get "http://10.132.0.252:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-fac043-openshift-default-7bc677c6b9-ld4n2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-fac043-7d54f45fdc-shkg8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-fac043-7f5bf697-vrxkn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2dbae9-6ccd966867-7qlsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2dbae9-7dd5d8cd79-wjpd6

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-710927-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-710927-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

models-as-a-service

kubelet

payload-processing-external-model-7f548df5c7-g5nft

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

Killing

Stopping container istio-proxy
(x10)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

Unhealthy

Readiness probe failed: Get "https://10.133.0.36:8000/ready": context deadline exceeded
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b659t

Unhealthy

Readiness probe failed: Get "http://10.133.0.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-2dbae9-openshift-default-7d88757d4f-strxt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x16)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

Unhealthy

Readiness probe failed: Get "https://10.133.0.36:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-zcv9p

Unhealthy

Liveness probe failed: Get "https://10.133.0.36:8000/health": context deadline exceeded

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-96tvd

Unhealthy

Readiness probe failed: Get "http://10.133.0.206:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-96tvd

ProbeError

Readiness probe error: Get "http://10.133.0.206:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b659t

ProbeError

Readiness probe error: Get "http://10.133.0.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

ProbeError

Readiness probe error: Get "http://10.133.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

Unhealthy

Readiness probe failed: Get "http://10.133.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c08360

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c08360
(x2)

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-b-c08360-openshift-default-848df6db77

SuccessfulCreate

Created pod: e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

openshift-ingress

multus

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

AddedInterface

Add eth0 [10.134.1.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-c08360-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c08360-openshift-default-848df6db77 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-8t5wq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-98ngt

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c08360

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c08360-58948b75c9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c08360

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c08360-8645d7ff59 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c08360-8645d7ff59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c08360: serviceaccount "payload-processing-e2e-inf-b-c08360" not found
(x6)

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

ProbeError

Startup probe error: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

Unhealthy

Startup probe failed: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c08360-58948b75c9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c08360-58948b75c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c08360: serviceaccount "payload-processing-e2e-inf-b-c08360" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c08360-58948b75c9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c08360-58948b75c9-k66nk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c08360-8645d7ff59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-s2tn2
(x7)

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

ProbeError

Startup probe error: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

Unhealthy

Startup probe failed: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-s2tn2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-c08360-58948b75c9-k66nk

AddedInterface

Add eth0 [10.133.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c08360-58948b75c9-k66nk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-s2tn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-s2tn2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-s2tn2

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c08360-58948b75c9-k66nk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c08360-58948b75c9-k66nk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c2d1b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c2d1b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-0877f5-6c8d64c49f-8t5wq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-0877f5-7b89c465c5-98ngt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-cd421c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-cd421c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-inf-a-1b0cce-openshift-default-585cd6bb59

SuccessfulCreate

Created pod: e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

openshift-ingress

deployment-controller

e2e-inf-a-1b0cce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1b0cce-openshift-default-585cd6bb59 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1b0cce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1b0cce

openshift-ingress

multus

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

AddedInterface

Add eth0 [10.134.1.51/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c2d1b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c2d1b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w0-0877f5-openshift-default-65f9674c97-p9xsd

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1b0cce-7996cb486f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1b0cce-7996cb486f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1b0cce: serviceaccount "payload-processing-e2e-inf-a-1b0cce" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-v4qx7

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1b0cce-7996cb486f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1b0cce-7996cb486f-vpwrv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1b0cce: serviceaccount "payload-processing-e2e-inf-a-1b0cce" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1b0cce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1b0cce-7996cb486f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1b0cce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-v4qx7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-v4qx7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-v4qx7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-1b0cce-7996cb486f-vpwrv

AddedInterface

Add eth0 [10.133.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1b0cce-7996cb486f-vpwrv

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-v4qx7

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1b0cce-7996cb486f-vpwrv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1b0cce-7996cb486f-vpwrv

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-cd421c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-cd421c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-710927-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-710927-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-710927-openshift-default-6b78cf7667 from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-a-710927-openshift-default-6b78cf7667

SuccessfulCreate

Created pod: e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-5fw8n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-q7drz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

Started

Container started

openshift-ingress

multus

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

AddedInterface

Add eth0 [10.134.1.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

Unhealthy

Startup probe failed: Get "http://10.134.1.53:15021/healthz/ready": dial tcp 10.134.1.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

ProbeError

Startup probe error: Get "http://10.134.1.53:15021/healthz/ready": dial tcp 10.134.1.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-6hr4x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-5237cd-57bcf4f5cf-5fw8n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-5237cd-657746898c-q7drz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-5237cd-openshift-default-5f58b4f7bf-xlcmw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b5989-94b469d6f-qd76b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-qgl9q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

ProbeError

Readiness probe error: Get "http://10.134.1.44:15021/healthz/ready": dial tcp 10.134.1.44:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

Unhealthy

Readiness probe failed: Get "http://10.134.1.44:15021/healthz/ready": dial tcp 10.134.1.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

Unhealthy

Startup probe failed: Get "http://10.134.1.44:15021/healthz/ready": dial tcp 10.134.1.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

ProbeError

Startup probe error: Get "http://10.134.1.44:15021/healthz/ready": dial tcp 10.134.1.44:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c08360-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c08360-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b5989-94b469d6f-qd76b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c2d1b8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-b-c2d1b8-openshift-default-584f96b4df

SuccessfulCreate

Created pod: e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b5989-7bdb89b88c-qgl9q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-inf-b-c2d1b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c2d1b8-openshift-default-584f96b4df from 1 to 2

openshift-ingress

multus

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

AddedInterface

Add eth0 [10.134.1.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

ProbeError

Startup probe error: Get "http://10.134.1.55:15021/healthz/ready": dial tcp 10.134.1.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

Unhealthy

Startup probe failed: Get "http://10.134.1.55:15021/healthz/ready": dial tcp 10.134.1.55:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c08360-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c08360-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1b0cce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1b0cce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5c54fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5c54fc

openshift-ingress

replicaset-controller

e2e-inf-b-5c54fc-openshift-default-6bcc667c45

SuccessfulCreate

Created pod: e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv

openshift-ingress

deployment-controller

e2e-inf-b-5c54fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5c54fc-openshift-default-6bcc667c45 from 0 to 1

openshift-ingress

multus

e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv

AddedInterface

Add eth0 [10.133.0.220/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

ProbeError

Startup probe error: Get "http://10.134.1.51:15021/healthz/ready": dial tcp 10.134.1.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

Unhealthy

Startup probe failed: Get "http://10.134.1.51:15021/healthz/ready": dial tcp 10.134.1.51:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5c54fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5c54fc-7467846795 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5c54fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5c54fc-5f9f868c59 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5c54fc-5f9f868c59

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5c54fc-5f9f868c59-s5bgq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5c54fc-7467846795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5c54fc-7467846795-qndhq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5c54fc-7467846795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5c54fc-7467846795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5c54fc: serviceaccount "payload-processing-e2e-inf-b-5c54fc" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5c54fc-5f9f868c59

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5c54fc-5f9f868c59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5c54fc: serviceaccount "payload-processing-e2e-inf-b-5c54fc" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5c54fc-5f9f868c59-s5bgq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5c54fc-7467846795-qndhq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5c54fc-5f9f868c59-s5bgq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5c54fc-5f9f868c59-s5bgq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5c54fc-7467846795-qndhq

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5c54fc-7467846795-qndhq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5c54fc-7467846795-qndhq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-5c54fc-5f9f868c59-s5bgq

AddedInterface

Add eth0 [10.132.1.5/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1b0cce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1b0cce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-hvq2k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-4b5989-openshift-default-578774676c-7lx2f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-w497b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4275b9-67997cc74f-twxgh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-a-cd421c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-cd421c-openshift-default-5b7f98b7b5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5

SuccessfulCreate

Created pod: e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv

Unhealthy

Startup probe failed: Get "http://10.133.0.220:15021/healthz/ready": dial tcp 10.133.0.220:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-cd421c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

AddedInterface

Add eth0 [10.134.1.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv

ProbeError

Startup probe error: Get "http://10.133.0.220:15021/healthz/ready": dial tcp 10.133.0.220:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

Unhealthy

Startup probe failed: Get "http://10.134.1.62:15021/healthz/ready": dial tcp 10.134.1.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

ProbeError

Startup probe error: Get "http://10.134.1.62:15021/healthz/ready": dial tcp 10.134.1.62:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5c54fc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5c54fc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4275b9-67997cc74f-twxgh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4275b9-5fb89685c5-w497b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5c54fc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5c54fc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-4275b9-openshift-default-67d67b45c-dbfns

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a5affe-86cc9766b5-278sw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-c6hdt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a5affe-86cc9766b5-278sw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a5affe-78c59c567-c6hdt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-a5affe-openshift-default-dd9b47fd9-6q2pd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-710927-5bdd596d55-2t8rq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-710927-7859f7d845-ht9pt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-710927-7859f7d845-ht9pt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-710927-5bdd596d55-2t8rq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-xqxjs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-710927-openshift-default-6b78cf7667-bfthz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 10 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vnvpp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-vnvpp

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b5dab-75bfb5c8df-nh5kr

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.145:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b5dab-59c4c79ff9-n89dv

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.146:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c2d1b8-79c64d499f-fd4zx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-s9xgp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-6b5dab-openshift-default-684774b79f-sbrtw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-p874b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-29mnm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c2d1b8-855f9987b7-s9xgp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c2d1b8-79c64d499f-fd4zx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-worker-w1-994336-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-994336-openshift-default-5dd7866d79 from 2 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5drlf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-994336-openshift-default-5dd7866d79

SuccessfulDelete

Deleted pod: e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 9 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-994336-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-96tvd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-gjgbb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gjgbb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-96tvd

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-5drlf

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-td8fx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-943963-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-943963-openshift-default-68fddd7bb5 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-943963-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-943963-openshift-default-68fddd7bb5

SuccessfulDelete

Deleted pod: e2e-extmod-a-943963-openshift-default-68fddd7bb5-h94kg

openshift-ingress

deployment-controller

e2e-worker-w3-106555-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-106555-openshift-default-5bdb5c6bc9 from 2 to 1

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9

SuccessfulDelete

Deleted pod: e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-dhhgh

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-106555-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-fslk6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-cc45a7-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7

SuccessfulDelete

Deleted pod: e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-kr6rn

openshift-ingress

deployment-controller

e2e-worker-w4-cc45a7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7 from 2 to 1
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-44405d-7c56f4d867-29mnm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-44405d-855f4cf98f-p874b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

ProbeError

Readiness probe error: Get "http://10.134.1.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-c2d1b8-openshift-default-584f96b4df-vg5rn

Unhealthy

Readiness probe failed: Get "http://10.134.1.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-vxrb9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-vxrb9
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-ld82r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-r978k

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-4bd51b-6b775cddf9-ld82r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-4bd51b-7d76c5559f-r978k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-44405d-openshift-default-6447558b8c-2slxp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-r4hv9

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r4hv9

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-4bd51b-openshift-default-b8544dc4f-jrkg8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cd421c-6884df5c6c-ns6q6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-8hf7s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-c16684-685b865b6c-qbtqr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-gjj44

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-bxss4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-v5wpt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-mnhzg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-cd421c-openshift-default-5b7f98b7b5-ltb5d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c34cbd-7dc696c947-v5wpt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c34cbd-559d4ccccf-bxss4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-cd421c-5f4c88c68c-8hf7s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-cd421c-6884df5c6c-ns6q6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-c16684-685b865b6c-qbtqr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c08360-58948b75c9-k66nk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-c16684-94dc7cbd7-gjj44

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-s2tn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-c34cbd-openshift-default-76b9b8b765-dp7tb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-c9dzw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-j78zf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w2-c16684-openshift-default-77c759c989-2q2df

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c08360-58948b75c9-k66nk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c08360-8645d7ff59-s2tn2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-c08360-openshift-default-848df6db77-dcc6z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-pnrxl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696f9a-67f544df69-gb7nm

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f1e791-7fdc98cb9f-c9dzw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f1e791-5f7f56dfff-j78zf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-f1e791-openshift-default-85667f7765-4wkgm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-n7kw6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-5lcg6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696f9a-67f544df69-gb7nm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696f9a-fc885d6c9-pnrxl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-696f9a-openshift-default-65db49bc97-mvhzb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1b0cce-7996cb486f-vpwrv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-v4qx7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a73b1-77b884cb9-g55qb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-j9ws8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w4-c744c0-openshift-default-5dfdb574cf-6mrl6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-c744c0-7c8c44f8c-5lcg6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-c744c0-7d8d5544b9-n7kw6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-4a73b1-openshift-default-5d7947885-jvj9j

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1b0cce-7f88b8d6dc-v4qx7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-1b0cce-openshift-default-585cd6bb59-snkm8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-d2tc9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-lpr6x

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a73b1-77b884cb9-g55qb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a73b1-7f9ccbd4c9-j9ws8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5c54fc-7467846795-qndhq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5c54fc-5f9f868c59-s5bgq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-v2lgh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-7prdg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-b36e62-openshift-default-5b64c855b5-g9lkt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-kf6vz
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-kf6vz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-b-5c54fc-openshift-default-6bcc667c45-q9cjv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b36e62-764477887-7prdg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-cc45a7-openshift-default-55cdb6f7d7-mxsbk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b36e62-5bb6746995-v2lgh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cc45a7-67fd74fc57-d2tc9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cc45a7-86f7d9c8c9-lpr6x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5c54fc-7467846795-qndhq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-fp9xd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-l6tzn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-943963-7568c9dd8c-99fk7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-943963-688574d587-7wwhp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-fb32d4-openshift-default-77bcc7c457-28h82

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-943963-openshift-default-68fddd7bb5-44fhf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-whppz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-994336-776fb75b4f-628xt

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-943963-7568c9dd8c-99fk7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-fb32d4-5b99d7f5ff-fp9xd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-943963-688574d587-7wwhp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-fb32d4-b4fd9fb87-l6tzn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-2jddx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56a6d4-6758676965-4l9dm

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-994336-55bfbff87f-whppz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-994336-776fb75b4f-628xt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-56a6d4-openshift-default-75f8d9db69-p7jkz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-994336-openshift-default-5dd7866d79-vb9h6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56a6d4-7769777f8c-2jddx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56a6d4-6758676965-4l9dm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-106555-openshift-default-5bdb5c6bc9-85g6z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-106555-849b8bdbd5-4trlx

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.53:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-106555-659c88c8f5-7hdjm

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.52:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-b659t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-b659t