Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-a-03004a-65dc4c599c-n964t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-03004a-65dc4c599c-n964t to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-03004a-5d58b9c94-bzv99

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-03004a-5d58b9c94-bzv99 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-9w4f9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-9w4f9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0239db-86587fc5bc-g5q4n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0239db-86587fc5bc-g5q4n to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm to ip-10-0-130-49.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-trcrk

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-trcrk to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9cc66e-597bf5b795-nfjhb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9cc66e-597bf5b795-nfjhb to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-676801-b8f7487cf-cgkdl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-676801-b8f7487cf-cgkdl to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f-2bgww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f-2bgww to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7-8fhxv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7-8fhxv to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

Preempted

Preempted by pod 08527e47-57a3-4a56-a70a-8681a6bce40e on node ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-50ac12-56dfcf7975-lr4fc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-50ac12-56dfcf7975-lr4fc to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

cert-manager

cert-manager-webhook-5dbbbf75cc-28qvk

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-28qvk to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1b634e-548469c467-llrgw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1b634e-548469c467-llrgw to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-f353c2-57fcc4666c-4jdp8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-f353c2-57fcc4666c-4jdp8 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-4db52a49-8bf57c599-pl8g6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-4db52a49-8bf57c599-pl8g6 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-zkssp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-zkssp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-w2bml

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-w2bml

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-t4tcg

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-t4tcg

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

kuadrant-system

authorino-544f7c9987-fwhzc

Scheduled

Successfully assigned kuadrant-system/authorino-544f7c9987-fwhzc to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-stvpm

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-stvpm

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-rhck7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-rhck7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-explicit-c8b702-6874d9474c-rwvbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c8b702-6874d9474c-rwvbx to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-nw6fl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-nw6fl to ip-10-0-133-98.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-w4tcj

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-w4tcj to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-dvzmv

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-dvzmv

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-c2x4s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-c2x4s to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-j7cvb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-j7cvb to ip-10-0-133-98.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-f4nls

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-f4nls to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-q6nc6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-q6nc6 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-99mp2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-99mp2 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-dfq2g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-dfq2g to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-gb6sg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-gb6sg to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-xlc4c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-xlc4c to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-mcjfw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-mcjfw to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-03004a-bb4884467-74p5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-03004a-bb4884467-74p5d to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq to ip-10-0-133-98.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-gx592

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-gx592 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-92tjp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-92tjp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-5tcws

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-5tcws

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-fwfh4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-fwfh4 to ip-10-0-141-145.us-east-2.compute.internal

cert-manager

cert-manager-597b95cb84-x7nxb

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-x7nxb to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-nrqpl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-nrqpl to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f-jff2m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f-jff2m to ip-10-0-133-98.us-east-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-2lt7l

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-2lt7l to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9f0694-747879f447-5mrn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9f0694-747879f447-5mrn2 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff-nz62n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff-nz62n to ip-10-0-133-98.us-east-2.compute.internal

kuadrant-system

authorino-8bb865d4-fvkqf

Scheduled

Successfully assigned kuadrant-system/authorino-8bb865d4-fvkqf to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-plspb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-plspb to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc-db4vr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc-db4vr to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5-76q9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5-76q9t to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7-frvx4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7-frvx4 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-40a891-7d847948c9-sxfw9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-40a891-7d847948c9-sxfw9 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87-472dh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87-472dh to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7-h8xrt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7-h8xrt to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5-2t4h6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5-2t4h6 to ip-10-0-133-98.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-b67f8

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-b67f8 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-925bac-76cc94458c-lffmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-925bac-76cc94458c-lffmd to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c-fnzlr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c-fnzlr to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9-xdm8b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9-xdm8b to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-aba34286-864fbc8f99-hknhs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-aba34286-864fbc8f99-hknhs to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-jxnxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-jxnxh to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-6198e156-56b455c78c-9wmm9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6198e156-56b455c78c-9wmm9 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-fnpzz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-fnpzz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-sxfk4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-sxfk4 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-4bf7efc6-5494979667-c2dg8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4bf7efc6-5494979667-c2dg8 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5-84wdf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5-84wdf to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-611693-7fcd9546c-sz9nm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-611693-7fcd9546c-sz9nm to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-pn828

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-pn828 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf-pvfnp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf-pvfnp to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff-d4rl4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff-d4rl4 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-278a56-786645f87f-jdwft

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-278a56-786645f87f-jdwft to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579-hps4q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579-hps4q to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-77e2b5-649795fff-jtszw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-77e2b5-649795fff-jtszw to ip-10-0-130-49.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-bzvnw

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-bzvnw to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-kdn78

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-kdn78

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5-nw9bs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5-nw9bs to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-bjfqm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-bjfqm to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-7cg9w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-7cg9w to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679-p4fzw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679-p4fzw to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-b4stk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-b4stk to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-mwxgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-mwxgr to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-rf4s6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-rf4s6 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7-z8fwv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7-z8fwv to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

Preempted

Preempted by pod 08527e47-57a3-4a56-a70a-8681a6bce40e on node ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9-nwtnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9-nwtnn to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447-w877l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447-w877l to ip-10-0-130-49.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-8wgfx

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-8wgfx to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-gj65l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-gj65l to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-2n9cv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-2n9cv to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-vwfr6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-vwfr6 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-cxqrw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-cxqrw to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-n7hhw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-n7hhw to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc to ip-10-0-133-98.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-46qd9

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-46qd9 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-jlf9h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-jlf9h to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn to ip-10-0-133-98.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7l4hn

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7l4hn to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-64487b45b7-zxz9q

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-64487b45b7-zxz9q to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-9sdpw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-9sdpw to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-lq6ms

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-lq6ms to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-4bf7efc6-54f688bc7-m4r2m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4bf7efc6-54f688bc7-m4r2m to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-6198e156-5456b9fd97-t2w7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6198e156-5456b9fd97-t2w7l to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-6e7ff10a-67cc6fb687-lw4q6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6e7ff10a-67cc6fb687-lw4q6 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-1b634e-5754895485-wswdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1b634e-5754895485-wswdk to ip-10-0-130-49.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-9nfbd

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-9nfbd to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-50ac12-776f46ff5-rrkq5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-50ac12-776f46ff5-rrkq5 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-zznwh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zznwh to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-676801-84b8cddcf-fm7th

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-676801-84b8cddcf-fm7th to ip-10-0-133-98.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-786vs

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-786vs to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-9cc66e-75ffd9f5f-kbckr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9cc66e-75ffd9f5f-kbckr to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-xljzj to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-0239db-568d9557f7-kv5lz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0239db-568d9557f7-kv5lz to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-x947t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-x947t to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-x47hr to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-276kh

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-276kh to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-b6b833-58bd44c469-sk2st

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b6b833-58bd44c469-sk2st to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-v46nb to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-ks486

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-ks486 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-jpp7c to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-d8xb2 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-api-b-e52ba1-6ff49f9b65-fkztl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-e52ba1-6ff49f9b65-fkztl to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-ea6cc6-575b4694c7-29mgg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-ea6cc6-575b4694c7-29mgg to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-f353c2-598dd8f8d5-vx9kw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-f353c2-598dd8f8d5-vx9kw to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-4db52a49-7bbbd869d5-rl7rq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-4db52a49-7bbbd869d5-rl7rq to ip-10-0-133-98.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-t4mgd

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-t4mgd to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-c8b702-85569ff95c-rvksj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c8b702-85569ff95c-rvksj to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-20538a-854c797489-sc8dk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-20538a-854c797489-sc8dk to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-2186c3-946d65949-m2fh7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-2186c3-946d65949-m2fh7 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-r5p9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-r5p9h to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-vskpv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-vskpv to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-bb5c51-547cf58c9-m4fp5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-bb5c51-547cf58c9-m4fp5 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-lbttn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-lbttn to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-2zjct

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-2zjct to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-c088fd-856769599-cg7dc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-c088fd-856769599-cg7dc to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-d0c6ff-796996887-2lpxd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-d0c6ff-796996887-2lpxd to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

Preempted

Preempted by pod 08527e47-57a3-4a56-a70a-8681a6bce40e on node ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-df9d42-675d896bc9-5b9bh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-df9d42-675d896bc9-5b9bh to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b6b833-66c66b5779-846g9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b6b833-66c66b5779-846g9 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-9vpv6 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r to ip-10-0-141-145.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-g8s4b

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-g8s4b to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-073e24-6587d56cd4-zd2wp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-073e24-6587d56cd4-zd2wp to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-073e24-84448c64c-2cs2g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-073e24-84448c64c-2cs2g to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-9f0694-5556cd996f-9tsrp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9f0694-5556cd996f-9tsrp to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-8qmll to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a3ff0c-5f649767d8-gq9xs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a3ff0c-5f649767d8-gq9xs to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5-6rlkd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5-6rlkd to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-40a891-674fcbf5bb-7zs82

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-40a891-674fcbf5bb-7zs82 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-40a891-b4565c8b9-h4chg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-40a891-b4565c8b9-h4chg to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9-f2b7h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9-f2b7h to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-90c4d1-cc54c76d6-d4bb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-90c4d1-cc54c76d6-d4bb8 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-925bac-5c47f5688d-qwwc5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-925bac-5c47f5688d-qwwc5 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-925bac-67c8b68c9-j7xf7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-925bac-67c8b68c9-j7xf7 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-cbbaec-7465d947c5-7h4qd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-cbbaec-7465d947c5-7h4qd to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4-c6wrn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4-c6wrn to ip-10-0-130-49.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-rmmmc

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-rmmmc to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-aba34286-7475c7489f-hfzqx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-aba34286-7475c7489f-hfzqx to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-cb5756cb-86dd696cc-jkhdb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cb5756cb-86dd696cc-jkhdb to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-6k8js to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-cb5756cb-86dd696cc-pf5db

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cb5756cb-86dd696cc-pf5db to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-wz8mb

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-wz8mb

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-6dz48 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-5f65e1-57d7b54575-2mxkk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-5f65e1-57d7b54575-2mxkk to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-611693-659f7dbbc-nv5rn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-611693-659f7dbbc-nv5rn to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-a779b3-55f94f74f7-lckxk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-a779b3-55f94f74f7-lckxk to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-b8d890-76f99c4c5c-r8p4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-b8d890-76f99c4c5c-r8p4t to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c-g4knv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c-g4knv to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-278a56-b55dfbf6c-wl4xf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-278a56-b55dfbf6c-wl4xf to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-726dd1-76dc5b5477-drjkc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-726dd1-76dc5b5477-drjkc to ip-10-0-133-98.us-east-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-cfzj2

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-cfzj2 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-77e2b5-6f96567b7c-qdkcz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-77e2b5-6f96567b7c-qdkcz to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95-2vgf7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95-2vgf7 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-l7jmh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-l7jmh to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889-qrtcz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889-qrtcz to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-5555cb-7f64c54897-vc7ct

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-5555cb-7f64c54897-vc7ct to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-8w2q2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-8w2q2 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-bnd5g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-bnd5g to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-jd6ft

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-jd6ft

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-f7fxd

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-f7fxd

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc-nvmsq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc-nvmsq to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-89e955-77fd5f8999-llbs6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-89e955-77fd5f8999-llbs6 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7-zj4nw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7-zj4nw to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-9zssq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-9zssq to ip-10-0-141-145.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88pg4v

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88pg4v to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-nt8g9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-nt8g9 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-cd929

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-cd929 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-rqzn7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-rqzn7 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-6ae519-5979494f57-gwzrt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-6ae519-5979494f57-gwzrt to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-r57ms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-r57ms to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-be6935-7cdc4bc59-wtf9p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-be6935-7cdc4bc59-wtf9p to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

Scheduled

Successfully assigned openshift-ingress/e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

router-default-54786d95-fr8g9

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-54786d95-fr8g9

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-54786d95-fr8g9

Scheduled

Successfully assigned openshift-ingress/router-default-54786d95-fr8g9 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq

Scheduled

Successfully assigned openshift-ingress/e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-mt-cb5756cb-openshift-default-9785d8d5c-jwp5s

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cb5756cb-openshift-default-9785d8d5c-jwp5s to ip-10-0-130-49.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-rzqnw

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-rzqnw to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-6b44bd95d7-xxzfx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6b44bd95d7-xxzfx to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt to ip-10-0-130-49.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-769c9bf4d4-zvj6h

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-769c9bf4d4-zvj6h to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-6b44bd95d7-tdrn5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6b44bd95d7-tdrn5 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-nbn54

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-nbn54 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k8mmq to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node.

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node.

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu.

openshift-ingress

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-ddrf6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ddrf6 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-chwsm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-chwsm to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-5p96n

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5p96n to ip-10-0-130-49.us-east-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-ldtbl

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ldtbl to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0239db-openshift-default-5cb4966c67-nq994 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-p6jpj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-p6jpj to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-vbxl5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-vbxl5 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s to ip-10-0-130-49.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx to ip-10-0-133-98.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-gb22h

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-gb22h to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-api-a-676801-openshift-default-d68754d77-nljqb

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-676801-openshift-default-d68754d77-nljqb to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z to ip-10-0-133-98.us-east-2.compute.internal

opendatahub

ai-gateway-controller-75686f85d5-6f7td

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-75686f85d5-6f7td to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-snv26

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-4whxt

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-4whxt to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-50ac12-openshift-default-65d95897c-ljcll to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-n8bs7

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-n8bs7 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-rbssh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-rbssh to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-8whxs

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-8whxs to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-snv26

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6 to ip-10-0-133-98.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-9kzpn

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-9kzpn to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2 to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747 to ip-10-0-130-49.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-2x7ns

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-2x7ns to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-jklmc

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-jklmc

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

Preempted

Preempted by pod 08527e47-57a3-4a56-a70a-8681a6bce40e on node ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5 to ip-10-0-130-49.us-east-2.compute.internal

opendatahub

maas-controller-7f756bf9c7-wkltg

Scheduled

Successfully assigned opendatahub/maas-controller-7f756bf9c7-wkltg to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx to ip-10-0-133-98.us-east-2.compute.internal

opendatahub

maas-controller-8555557b5d-s7mt2

Scheduled

Successfully assigned opendatahub/maas-controller-8555557b5d-s7mt2 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-98f7774f-f966s

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-f966s to ip-10-0-141-145.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-69496c6ffb-pm9wz to ip-10-0-130-49.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-69496c6ffb-h8kpz to ip-10-0-133-98.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-69496c6ffb-cp2sb to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-qlv8w

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-qlv8w to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-s9rxb

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-s9rxb to ip-10-0-130-49.us-east-2.compute.internal

opendatahub

test-curl-11428-a047dd

Scheduled

Successfully assigned opendatahub/test-curl-11428-a047dd to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72 to ip-10-0-133-98.us-east-2.compute.internal

opendatahub

test-curl-11422-7a414d

Scheduled

Successfully assigned opendatahub/test-curl-11422-7a414d to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd to ip-10-0-130-49.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-4bjhg

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-4bjhg to ip-10-0-130-49.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4 to ip-10-0-133-98.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv to ip-10-0-133-98.us-east-2.compute.internal

opendatahub

test-curl-11422-41c96c

Scheduled

Successfully assigned opendatahub/test-curl-11422-41c96c to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

test-curl-11422-009566

Scheduled

Successfully assigned opendatahub/test-curl-11422-009566 to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

test-curl-11419-dc8377

Scheduled

Successfully assigned opendatahub/test-curl-11419-dc8377 to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

test-curl-11419-662c0f

Scheduled

Successfully assigned opendatahub/test-curl-11419-662c0f to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

test-curl-11419-314a63

Scheduled

Successfully assigned opendatahub/test-curl-11419-314a63 to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

test-curl-11419-185384

Scheduled

Successfully assigned opendatahub/test-curl-11419-185384 to ip-10-0-141-145.us-east-2.compute.internal

opendatahub

test-curl-11419-236a81

Scheduled

Successfully assigned opendatahub/test-curl-11419-236a81 to ip-10-0-141-145.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-54786d95 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-54786d95

FailedCreate

Error creating: pods "router-default-54786d95-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-54786d95

SuccessfulCreate

Created pod: router-default-54786d95-fr8g9
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-54786d95-fr8g9

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-54786d95-fr8g9

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-54786d95-fr8g9

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-54786d95-fr8g9

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-54786d95-fr8g9

Started

Container started

openshift-ingress

multus

router-default-54786d95-fr8g9

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-54786d95-fr8g9

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-54786d95-fr8g9

Created

Container created

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-vbxl5

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-vbxl5

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-vbxl5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-vbxl5

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-vbxl5

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-vbxl5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.577s (3.577s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-vbxl5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-vbxl5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-c9ffffc7f from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-64487b45b7

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-64487b45b7-zxz9q

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-8qmll

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-64487b45b7 from 0 to 1

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64487b45b7-zxz9q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-64487b45b7-zxz9q

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.524s (3.524s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64487b45b7-zxz9q

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64487b45b7-zxz9q

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64487b45b7-zxz9q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.749s (6.749s including waiting). Image size: 183555333 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-69496c6ffb

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-69496c6ffb-pm9wz

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-69496c6ffb

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-69496c6ffb-h8kpz

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-69496c6ffb from 0 to 3

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-69496c6ffb

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-69496c6ffb-cp2sb

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

install-h2b9r

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-trcrk

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-trcrk

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-trcrk
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.831s (3.831s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 4.729s (4.729s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 4.316s (4.316s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 408ms (408ms including waiting). Image size: 273709574 bytes.

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-gb22h

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 390ms (390ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-h8kpz

Created

Container created

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-cp2sb

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

opendatahub-operator-controller-manager-69496c6ffb-pm9wz_e004d8d7-2142-47b2-8391-86b524996cf2

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-69496c6ffb-pm9wz_e004d8d7-2142-47b2-8391-86b524996cf2 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 410ms (410ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69496c6ffb-pm9wz

Created

Container created

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-gb22h

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-gb22h

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-28qvk

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-28qvk

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-28qvk

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes
(x12)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-28qvk

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-28qvk

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.074s (2.074s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-trcrk

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-trcrk

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-trcrk

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 6.352s (6.352s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-28qvk

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-gb22h

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-gb22h

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-gb22h

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 4.161s (4.161s including waiting). Image size: 224874686 bytes.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-gb22h_350121d6-3ffc-4b2a-b026-9d380db959fb became leader

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-b67f8

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

multus

authorino-operator-7b7bb4bc77-b67f8

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b67f8

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-bzvnw

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-bzvnw

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-bzvnw

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

authorino-operator-7b7bb4bc77-b67f8_0a909ecd-d440-44a8-868b-f0c19c3468ec

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-b67f8_0a909ecd-d440-44a8-868b-f0c19c3468ec became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b67f8

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b67f8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 3.465s (3.465s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b67f8

Created

Container created

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-x7nxb

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-276kh

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-276kh

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-276kh

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-bzvnw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 3.856s (3.856s including waiting). Image size: 190804149 bytes.

cert-manager

kubelet

cert-manager-597b95cb84-x7nxb

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

multus

cert-manager-597b95cb84-x7nxb

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-x7nxb

Started

Container started

kuadrant-system

dns-operator-controller-manager-8557cbdb84-bzvnw_3485142a-b57c-49b8-994d-aff9deaba39f

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-bzvnw_3485142a-b57c-49b8-994d-aff9deaba39f became leader

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-bzvnw

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-x7nxb

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-bzvnw

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-276kh

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-276kh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.869s (1.869s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-276kh

Created

Container created

kuadrant-system

limitador-operator-controller-manager-5778bb4449-276kh_14b3b115-0872-4f85-b3fb-dd2859ad78ba

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-276kh_14b3b115-0872-4f85-b3fb-dd2859ad78ba became leader

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-7l4hn

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7l4hn

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-7l4hn

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-98f7774f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-98f7774f-f966s

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-6b44bd95d7

SuccessfulCreate

Created pod: kube-auth-proxy-6b44bd95d7-tdrn5

openshift-ingress

replicaset-controller

kube-auth-proxy-6b44bd95d7

SuccessfulCreate

Created pod: kube-auth-proxy-6b44bd95d7-xxzfx

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6b44bd95d7 from 0 to 2

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-98f7774f from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-98f7774f-f966s

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-6b44bd95d7-xxzfx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-6b44bd95d7-tdrn5

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7l4hn

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7l4hn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.667s (5.667s including waiting). Image size: 424244516 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-98f7774f-f966s

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-98f7774f-f966s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-98f7774f-f966s

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6b44bd95d7-tdrn5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7l4hn_edde0759-502d-4531-a5d7-9d7f9767648a

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-7l4hn_edde0759-502d-4531-a5d7-9d7f9767648a became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7l4hn

Created

Container created

openshift-ingress

multus

kube-auth-proxy-6b44bd95d7-xxzfx

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

kube-auth-proxy-6b44bd95d7-tdrn5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.728s (2.728s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6b44bd95d7-tdrn5

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-6b44bd95d7-tdrn5

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-6b44bd95d7-xxzfx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.999s (2.999s including waiting). Image size: 188904677 bytes.

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-8whxs

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6b44bd95d7-xxzfx

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-6b44bd95d7-xxzfx

Created

Container created

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-8whxs

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-8whxs

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-8whxs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.393s (2.393s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-8whxs

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-8whxs

Started

Container started

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-8hj6n"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-hpm96"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

multus

jobset-controller-manager-769c9bf4d4-zvj6h

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-769c9bf4d4

SuccessfulCreate

Created pod: jobset-controller-manager-769c9bf4d4-zvj6h

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-769c9bf4d4-zvj6h

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-769c9bf4d4 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

jobset-controller-manager-769c9bf4d4-zvj6h_b20dfad0-2304-4055-8d76-e9b323f7015e

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-769c9bf4d4-zvj6h_b20dfad0-2304-4055-8d76-e9b323f7015e became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-769c9bf4d4-zvj6h

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-769c9bf4d4-zvj6h

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-769c9bf4d4-zvj6h

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.938s (2.938s including waiting). Image size: 182184678 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kserve-module-controller-manager-7566cf5fc8-8whxs_16574e87-9fb8-4d3e-891c-5b516450b649

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-8whxs_16574e87-9fb8-4d3e-891c-5b516450b649 became leader

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-4bjhg

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-n8bs7

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-s9rxb

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-2x7ns

opendatahub

multus

kserve-controller-manager-776cc66d47-n8bs7

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

multus

model-serving-api-75bd89fdfc-s9rxb

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-n8bs7

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-5p96n

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-2x7ns

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2x7ns

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-5p96n

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p96n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

opendatahub

multus

odh-model-controller-769875db56-4bjhg

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-s9rxb

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

odh-model-controller-769875db56-4bjhg

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p96n

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p96n

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2x7ns

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-n8bs7

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.056s (2.056s including waiting). Image size: 247676581 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-vbxl5

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-vbxl5

opendatahub

kubelet

model-serving-api-75bd89fdfc-s9rxb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.477s (2.477s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-s9rxb

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-n8bs7

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-s9rxb

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-n8bs7

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2x7ns

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 1.951s (1.951s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2x7ns

Created

Container created

opendatahub

odh-model-controller-769875db56-4bjhg_15c24465-cb10-405f-ac83-cb3edeaf6f3f

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-4bjhg_15c24465-cb10-405f-ac83-cb3edeaf6f3f became leader

opendatahub

kubelet

odh-model-controller-769875db56-4bjhg

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-n8bs7_3a450c7a-8702-4e35-9b7b-b745855f797a

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-n8bs7_3a450c7a-8702-4e35-9b7b-b745855f797a became leader

opendatahub

kubelet

odh-model-controller-769875db56-4bjhg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.326s (3.326s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-4bjhg

Created

Container created

opendatahub

llmisvc-controller-manager-869d5dcc5d-2x7ns_0d763a00-4dc3-4712-9902-8290646b39da

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-2x7ns_0d763a00-4dc3-4712-9902-8290646b39da became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-46qd9

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7l4hn

Killing

Stopping container manager

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-46qd9

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-46qd9

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-46qd9

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-46qd9

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-9nfbd

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-8wgfx

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-46qd9_6de269d2-34b7-4163-8552-be11f9691a71

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-46qd9_6de269d2-34b7-4163-8552-be11f9691a71 became leader

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8wgfx

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-f4nls

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-w4tcj

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-786vs

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-7c9b87d574-786vs

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-786vs

kuadrant-system

multus

limitador-limitador-74dfcfb894-9nfbd

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-8wgfx

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9nfbd

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

authorino-56c6c9ddd5-w4tcj

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-f4nls

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-f4nls

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-w4tcj

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-786vs

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9nfbd

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9nfbd

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.759s (1.759s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-786vs

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.343s (1.343s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9nfbd

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-786vs

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-f4nls

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-f4nls

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-f4nls

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.218s (2.218s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-w4tcj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 6.57s (6.57s including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-f4nls

kuadrant-system

kubelet

authorino-57f7f8659f-f4nls

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-56c6c9ddd5-w4tcj

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-w4tcj

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9nfbd

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-9nfbd

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8wgfx

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8wgfx

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8wgfx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 34.502s (34.502s including waiting). Image size: 342538866 bytes.

opendatahub

replicaset-controller

maas-controller-8555557b5d

SuccessfulCreate

Created pod: maas-controller-8555557b5d-s7mt2

opendatahub

multus

maas-controller-7f756bf9c7-wkltg

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-7f756bf9c7

SuccessfulCreate

Created pod: maas-controller-7f756bf9c7-wkltg

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7f756bf9c7 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-8555557b5d from 0 to 1

opendatahub

kubelet

maas-controller-7f756bf9c7-wkltg

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:bf5c4563c4263e71c7401d12715f8c30723d9ad4690add3740fa029824dadfea"

opendatahub

kubelet

maas-controller-8555557b5d-s7mt2

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:bf5c4563c4263e71c7401d12715f8c30723d9ad4690add3740fa029824dadfea"

opendatahub

multus

maas-controller-8555557b5d-s7mt2

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7f756bf9c7-wkltg

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:bf5c4563c4263e71c7401d12715f8c30723d9ad4690add3740fa029824dadfea" in 4.332s (4.332s including waiting). Image size: 200094711 bytes.

opendatahub

kubelet

maas-controller-8555557b5d-s7mt2

Created

Container created

opendatahub

kubelet

maas-controller-7f756bf9c7-wkltg

Created

Container created

opendatahub

kubelet

maas-controller-7f756bf9c7-wkltg

Started

Container started

opendatahub

kubelet

maas-controller-8555557b5d-s7mt2

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:bf5c4563c4263e71c7401d12715f8c30723d9ad4690add3740fa029824dadfea" in 3.824s (3.824s including waiting). Image size: 200094711 bytes.

opendatahub

kubelet

maas-controller-8555557b5d-s7mt2

Started

Container started

opendatahub

maas-controller-8555557b5d-s7mt2_7d48ebcd-a4c0-4350-bae5-175d15149a17

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-8555557b5d-s7mt2_7d48ebcd-a4c0-4350-bae5-175d15149a17 became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-qlv8w

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qlv8w

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-qlv8w

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7f756bf9c7-wkltg

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-7f756bf9c7

SuccessfulDelete

Deleted pod: maas-controller-7f756bf9c7-wkltg

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7f756bf9c7 from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qlv8w

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 11.32s (11.32s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qlv8w

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qlv8w

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

Unhealthy

Readiness probe failed: Get "http://10.132.0.37:15021/healthz/ready": read tcp 10.132.0.2:48954->10.132.0.37:15021: read: connection reset by peer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

ProbeError

Readiness probe error: Get "http://10.132.0.37:15021/healthz/ready": read tcp 10.132.0.2:48954->10.132.0.37:15021: read: connection reset by peer body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

Started

Container started

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-2lt7l

kuadrant-system

replicaset-controller

authorino-8bb865d4

SuccessfulCreate

Created pod: authorino-8bb865d4-fvkqf

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-8bb865d4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-gx592

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-gx592

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-2lt7l

kuadrant-system

kubelet

authorino-6889cbd8c4-gx592

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-8bb865d4-fvkqf

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6889cbd8c4-gx592

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

kuadrant-system

multus

authorino-8bb865d4-fvkqf

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6889cbd8c4-gx592

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-w4tcj

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6889cbd8c4-gx592

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.322s (1.322s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-8bb865d4-fvkqf

Created

Container created

kuadrant-system

kubelet

authorino-8bb865d4-fvkqf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 765ms (765ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-gx592

Started

Container started

kuadrant-system

kubelet

authorino-8bb865d4-fvkqf

Started

Container started

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-w4tcj

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-9kzpn

kuadrant-system

kubelet

authorino-6889cbd8c4-gx592

Killing

Stopping container authorino

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-9kzpn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 471ms (471ms including waiting). Image size: 235100981 bytes.
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-9kzpn

Created

Container created

opendatahub

multus

llmisvc-controller-manager-6466c554d8-9kzpn

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-9kzpn

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-9kzpn

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-2x7ns

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-2x7ns

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

ai-gateway-controller-7d85675f98-4whxt

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-4whxt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-4whxt

opendatahub

kubelet

ai-gateway-controller-7d85675f98-4whxt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.768s (2.768s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-4whxt

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-4whxt

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-4whxt_7a0f73e3-b03a-4039-9989-bd2bebadb905

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-4whxt_7a0f73e3-b03a-4039-9989-bd2bebadb905 became leader
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-cxqrw

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-lq6ms

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-lq6ms

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-cxqrw

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-lq6ms

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-cxqrw

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-lq6ms

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-cxqrw

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-lq6ms

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.171s (2.171s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-lq6ms

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-cxqrw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-cxqrw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.168s (2.168s including waiting). Image size: 125353965 bytes.

opendatahub

kubelet

ai-gateway-controller-75686f85d5-6f7td

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

replicaset-controller

ai-gateway-controller-75686f85d5

SuccessfulCreate

Created pod: ai-gateway-controller-75686f85d5-6f7td

opendatahub

multus

ai-gateway-controller-75686f85d5-6f7td

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-75686f85d5 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-75686f85d5-6f7td

Started

Container started

opendatahub

kubelet

ai-gateway-controller-75686f85d5-6f7td

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 471ms (471ms including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-75686f85d5-6f7td

Created

Container created

opendatahub

llmisvc-controller-manager-6466c554d8-9kzpn_055accd3-96c0-48b8-a56c-aa0d5389edda

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-9kzpn_055accd3-96c0-48b8-a56c-aa0d5389edda became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-4whxt

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-4whxt

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-t4mgd

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-t4mgd

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-t4mgd

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-g8s4b

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-rmmmc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-g8s4b

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-t4mgd

Started

Container started

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-g8s4b

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-t4mgd

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-t4mgd

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.74s (1.74s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-rmmmc

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-rmmmc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-g8s4b

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-g8s4b

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-g8s4b

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.43s (1.43s including waiting). Image size: 98346788 bytes.

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88pg4v

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-rmmmc

Created

Container created

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-cfzj2

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-rmmmc

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-cfzj2

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-rmmmc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 856ms (856ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-cfzj2

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-cfzj2

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 280ms (280ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-cfzj2

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-cfzj2

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88pg4v

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88pg4v

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 267ms (267ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88pg4v

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88pg4v

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88pg4v

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-rzqnw

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-rzqnw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-ldtbl

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-ldtbl

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-ldtbl

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

echo-simulator-kserve-64b6f8f96c-rzqnw

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-ldtbl

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 325ms (325ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-ldtbl

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-ldtbl

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-rzqnw

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-rzqnw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.148s (2.148s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

kubelet

echo-simulator-kserve-64b6f8f96c-rzqnw

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 276ms (276ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

Created

Container created
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

opendatahub

ai-gateway-controller-75686f85d5-6f7td_4c45c436-88e1-44e9-8af8-4f05e7f9c7a4

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-75686f85d5-6f7td_4c45c436-88e1-44e9-8af8-4f05e7f9c7a4 became leader

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

kuadrant-system

replicaset-controller

authorino-544f7c9987

SuccessfulCreate

Created pod: authorino-544f7c9987-fwhzc

kuadrant-system

kubelet

authorino-544f7c9987-fwhzc

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-544f7c9987-fwhzc

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-544f7c9987-fwhzc

Started

Container started

kuadrant-system

kubelet

authorino-544f7c9987-fwhzc

Created

Container created

kuadrant-system

kubelet

authorino-544f7c9987-fwhzc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.057s (1.057s including waiting). Image size: 204096810 bytes.

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-6k8js

kuadrant-system

kubelet

authorino-8bb865d4-fvkqf

Killing

Stopping container authorino

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-c9ffffc7f from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-xljzj
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-8bb865d4 from 1 to 0

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-x947t

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

kuadrant-system

replicaset-controller

authorino-8bb865d4

SuccessfulDelete

Deleted pod: authorino-8bb865d4-fvkqf

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x947t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-x947t

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x947t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.671s (3.671s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x947t

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x947t

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x947t

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x947t

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-6dz48

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-c9ffffc7f from 4 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c

SuccessfulCreate

Created pod: e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

openshift-ingress

deployment-controller

e2e-ait-6e7ff10a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6e7ff10a-openshift-default-5f8cb775f7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-6e7ff10a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6e7ff10a

openshift-ingress

gateway_labeler_controller

e2e-migrate-aba34286-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-aba34286-gw

openshift-ingress

deployment-controller

e2e-ait-4bf7efc6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4bf7efc6-openshift-default-b79fc4f4c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7

SuccessfulCreate

Created pod: e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

openshift-ingress

gateway_labeler_controller

e2e-ait-4bf7efc6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4bf7efc6

openshift-ingress

replicaset-controller

e2e-migrate-aba34286-gw-openshift-default-68f4b54c77

SuccessfulCreate

Created pod: e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2

openshift-ingress

deployment-controller

e2e-migrate-aba34286-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-aba34286-gw-openshift-default-68f4b54c77 from 0 to 1

openshift-ingress

multus

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-6198e156-openshift-default-59754d6d67

SuccessfulCreate

Created pod: e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

openshift-ingress

deployment-controller

e2e-ait-6198e156-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6198e156-openshift-default-59754d6d67 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-6198e156

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6198e156

openshift-ingress

multus

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4bf7efc6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4bf7efc6-5494979667 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4bf7efc6-5494979667

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4bf7efc6-5494979667-c2dg8

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6e7ff10a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6e7ff10a-67cc6fb687 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4bf7efc6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4bf7efc6-54f688bc7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-4bf7efc6-5494979667-c2dg8

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4bf7efc6-54f688bc7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4bf7efc6-54f688bc7-m4r2m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4bf7efc6-54f688bc7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4bf7efc6-54f688bc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4bf7efc6: serviceaccount "payload-processing-e2e-ait-4bf7efc6" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4bf7efc6-5494979667

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4bf7efc6-5494979667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4bf7efc6: serviceaccount "payload-processing-e2e-ait-4bf7efc6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bf7efc6-5494979667-c2dg8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-6e7ff10a-67cc6fb687-lw4q6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bf7efc6-5494979667-c2dg8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bf7efc6-5494979667-c2dg8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff-nz62n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-6e7ff10a-67cc6fb687-lw4q6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-4bf7efc6-54f688bc7-m4r2m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-aba34286-864fbc8f99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-aba34286-864fbc8f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-aba34286: serviceaccount "payload-processing-e2e-migrate-aba34286" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-aba34286-864fbc8f99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-aba34286-864fbc8f99-hknhs

openshift-ingress

kubelet

payload-processing-e2e-ait-4bf7efc6-54f688bc7-m4r2m

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6e7ff10a: serviceaccount "payload-processing-e2e-ait-6e7ff10a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-aba34286-7475c7489f

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-aba34286-7475c7489f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-aba34286: serviceaccount "payload-processing-e2e-migrate-aba34286" not found

openshift-ingress

multus

payload-processing-e2e-ait-6e7ff10a-67cc6fb687-lw4q6

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-4bf7efc6-54f688bc7-m4r2m

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff-nz62n

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6e7ff10a-67cc6fb687-lw4q6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff-nz62n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6e7ff10a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-aba34286

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-aba34286-864fbc8f99 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-4bf7efc6-54f688bc7-m4r2m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff-nz62n

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff-nz62n

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6e7ff10a-67cc6fb687

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6e7ff10a-67cc6fb687-lw4q6

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-aba34286

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-aba34286-7475c7489f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-aba34286-7475c7489f

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-aba34286-7475c7489f-hfzqx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6e7ff10a-67cc6fb687

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6e7ff10a-67cc6fb687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6e7ff10a: serviceaccount "payload-processing-e2e-ait-6e7ff10a" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-aba34286-7475c7489f-hfzqx

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6198e156

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6198e156-56b455c78c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-aba34286-7475c7489f-hfzqx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-migrate-aba34286-7475c7489f-hfzqx

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-aba34286-864fbc8f99-hknhs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-aba34286-864fbc8f99-hknhs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6198e156-56b455c78c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6198e156-56b455c78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6198e156: serviceaccount "payload-processing-e2e-ait-6198e156" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6198e156-5456b9fd97

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6198e156-5456b9fd97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6198e156: serviceaccount "payload-processing-e2e-ait-6198e156" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-aba34286-864fbc8f99-hknhs

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6198e156

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6198e156-5456b9fd97 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-aba34286-864fbc8f99-hknhs

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-aba34286-7475c7489f-hfzqx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-6198e156-5456b9fd97-t2w7l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6198e156-56b455c78c-9wmm9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6198e156-56b455c78c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6198e156-56b455c78c-9wmm9

openshift-ingress

multus

payload-processing-e2e-ait-6198e156-5456b9fd97-t2w7l

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6198e156-5456b9fd97

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6198e156-5456b9fd97-t2w7l

openshift-ingress

kubelet

payload-processing-e2e-ait-6198e156-5456b9fd97-t2w7l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-6198e156-5456b9fd97-t2w7l

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-6198e156-56b455c78c-9wmm9

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6198e156-56b455c78c-9wmm9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6198e156-56b455c78c-9wmm9

Created

Container created

openshift-ingress

multus

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-4db52a49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-4db52a49

openshift-ingress

replicaset-controller

e2e-derive-4db52a49-openshift-default-5fbc59957c

SuccessfulCreate

Created pod: e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

openshift-ingress

deployment-controller

e2e-derive-4db52a49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-4db52a49-openshift-default-5fbc59957c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4db52a49-7bbbd869d5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-4db52a49-7bbbd869d5-rl7rq
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4db52a49-7bbbd869d5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-4db52a49-7bbbd869d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4db52a49: serviceaccount "payload-processing-e2e-derive-4db52a49" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4db52a49-8bf57c599

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-4db52a49-8bf57c599-pl8g6

openshift-ingress

deployment-controller

payload-processing-e2e-derive-4db52a49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-4db52a49-7bbbd869d5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4db52a49-8bf57c599

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-4db52a49-8bf57c599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4db52a49: serviceaccount "payload-processing-e2e-derive-4db52a49" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-4db52a49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-4db52a49-8bf57c599 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6e7ff10a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-4db52a49-7bbbd869d5-rl7rq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-derive-4db52a49-8bf57c599-pl8g6

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6e7ff10a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-4db52a49-7bbbd869d5-rl7rq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-4db52a49-7bbbd869d5-rl7rq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-4db52a49-7bbbd869d5-rl7rq

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4db52a49-8bf57c599-pl8g6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-aba34286-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-aba34286-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4db52a49-8bf57c599-pl8g6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4db52a49-8bf57c599-pl8g6

Started

Container started

openshift-ingress

kubelet

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

ProbeError

Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

Unhealthy

Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

Unhealthy

Readiness probe failed: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

ProbeError

Readiness probe error: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

Created

Container created

openshift-ingress

kubelet

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4bf7efc6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4bf7efc6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6e7ff10a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6e7ff10a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-aba34286-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-aba34286-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6198e156-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6198e156-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-6e7ff10a-67cc6fb687-lw4q6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e7ff10a-c6d4f5dff-nz62n

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-6e7ff10a-openshift-default-5f8cb775f7-flk8t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-4db52a49-7bbbd869d5-rl7rq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4db52a49-8bf57c599-pl8g6

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-be6935

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-be6935

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4bf7efc6-54f688bc7-m4r2m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-aba34286-864fbc8f99-hknhs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-aba34286-7475c7489f-hfzqx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bf7efc6-5494979667-c2dg8

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4db52a49-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4db52a49-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-4bf7efc6-openshift-default-b79fc4f4c-2hwzq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6198e156-56b455c78c-9wmm9

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-6ae519

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-6ae519

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

openshift-ingress

kubelet

payload-processing-e2e-ait-6198e156-5456b9fd97-t2w7l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-4db52a49-openshift-default-5fbc59957c-8q6xg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-0e8b5c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-0e8b5c

openshift-ingress

kubelet

e2e-migrate-aba34286-gw-openshift-default-68f4b54c77-7p2z2

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-be6935-7cdc4bc59

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-be6935-7cdc4bc59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-be6935: serviceaccount "payload-processing-e2e-worker-w4-be6935" not found

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-7e5955

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-7e5955

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-be6935

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-9sdpw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-be6935: serviceaccount "payload-processing-e2e-worker-w4-be6935" not found

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-be6935

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-be6935-7cdc4bc59 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-be6935-7cdc4bc59

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-be6935-7cdc4bc59-wtf9p

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-9sdpw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-be6935-7cdc4bc59-wtf9p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-be6935-7cdc4bc59-wtf9p

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-9sdpw

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-9sdpw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-be6935-7cdc4bc59-wtf9p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-be6935-7cdc4bc59-wtf9p

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-9sdpw

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-3cf6f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-3cf6f4

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 0 to 1

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-6ae519-5979494f57

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-6ae519-5979494f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-6ae519: serviceaccount "payload-processing-e2e-worker-w2-6ae519" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-0e8b5c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-jlf9h

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-6ae519-5979494f57

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-6ae519-5979494f57-gwzrt

openshift-ingress

multus

payload-processing-e2e-worker-w2-6ae519-5979494f57-gwzrt

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6ae519-5979494f57-gwzrt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-6ae519: serviceaccount "payload-processing-e2e-worker-w2-6ae519" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-jlf9h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-jlf9h

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-0e8b5c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-6ae519

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-6ae519-5979494f57 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6ae519-5979494f57-gwzrt

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-6ae519

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-7e5955: serviceaccount "payload-processing-e2e-worker-w3-7e5955" not found

openshift-ingress

multus

payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-rqzn7

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-7e5955

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-7e5955

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-7e5955-54cd86c7cc from 0 to 1

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-n7hhw

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-6198e156-openshift-default-59754d6d67-zkkdl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-n7hhw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-rqzn7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-0e8b5c: serviceaccount "payload-processing-e2e-worker-w1-0e8b5c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-jlf9h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-jlf9h

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-n7hhw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-7e5955-54cd86c7cc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-7e5955: serviceaccount "payload-processing-e2e-worker-w3-7e5955" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-0e8b5c: serviceaccount "payload-processing-e2e-worker-w1-0e8b5c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-rqzn7

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6ae519-5979494f57-gwzrt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-r57ms

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-r57ms

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-r57ms

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-n7hhw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-r57ms

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-n7hhw

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-7e5955-54cd86c7cc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-r57ms

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-rqzn7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-rqzn7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-3cf6f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-cd929
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3cf6f4: serviceaccount "payload-processing-e2e-worker-w0-3cf6f4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-3cf6f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-vwfr6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3cf6f4: serviceaccount "payload-processing-e2e-worker-w0-3cf6f4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-cd929

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-vwfr6

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-cd929

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-vwfr6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-vwfr6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-cd929

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-cd929

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-vwfr6

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr

Created

Container created

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

Started

Container started

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 2 to 4

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

Created

Container created

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-zznwh

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-ks486

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-ks486

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-ks486

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-zznwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-v46nb

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-c9ffffc7f from 6 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-zznwh

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-ks486

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-ks486

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-zznwh

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-zznwh
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-ks486

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-ks486

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-zznwh

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-zznwh

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-ks486

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-ks486

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 2 to 4

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

Started

Container started

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-zznwh

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-zznwh

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

Created

Container created

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ddrf6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-ddrf6

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-ddrf6

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ddrf6

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ddrf6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.884s (2.884s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ddrf6

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ddrf6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ddrf6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 5 to 9

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

Started

Container started

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

Created

Container created

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 8 to 9

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes
(x11)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x11)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 8 to 9

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

Unhealthy

Readiness probe failed: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

ProbeError

Readiness probe error: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub

kubelet

model-serving-api-75bd89fdfc-s9rxb

Unhealthy

Readiness probe failed: Get "https://10.133.0.20:8443/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

Unhealthy

Readiness probe failed: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

ProbeError

Readiness probe error: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

Unhealthy

Readiness probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

Unhealthy

Readiness probe failed: Get "https://10.133.0.30:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 9 to 10

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

Created

Container created

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

Unhealthy

Readiness probe failed: Get "https://10.133.0.30:8000/ready": context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 9 to 10

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 3 to 6
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

Unhealthy

Liveness probe failed: Get "https://10.133.0.30:8000/health": context deadline exceeded

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

Started

Container started

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

Started

Container started

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

ProbeError

Readiness probe error: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-mt-cb5756cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cb5756cb

openshift-ingress

deployment-controller

e2e-mt-cb5756cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cb5756cb-openshift-default-9785d8d5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-cb5756cb-openshift-default-9785d8d5c

SuccessfulCreate

Created pod: e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

Unhealthy

Readiness probe failed: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

openshift-ingress

multus

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 6 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

Created

Container created

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-jxnxh

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cb5756cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cb5756cb-86dd696cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cb5756cb-86dd696cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cb5756cb-86dd696cc-jkhdb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cb5756cb-86dd696cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cb5756cb-86dd696cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cb5756cb: serviceaccount "payload-processing-e2e-mt-cb5756cb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cb5756cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cb5756cb-7885d746b7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cb5756cb: serviceaccount "payload-processing-e2e-mt-cb5756cb" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-cb5756cb-86dd696cc-jkhdb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-jxnxh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-jxnxh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-cb5756cb-86dd696cc-jkhdb

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cb5756cb-86dd696cc-jkhdb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-cb5756cb-86dd696cc-jkhdb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-jxnxh

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-jxnxh

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-a-1b634e-openshift-default-d66ff8bf5

SuccessfulCreate

Created pod: e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx

openshift-ingress

gateway_labeler_controller

e2e-api-a-1b634e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1b634e

openshift-ingress

deployment-controller

e2e-api-a-1b634e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1b634e-openshift-default-d66ff8bf5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-9cc66e-openshift-default-7757695b65

SuccessfulCreate

Created pod: e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

openshift-ingress

deployment-controller

e2e-api-a-9cc66e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9cc66e-openshift-default-7757695b65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-9cc66e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9cc66e
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

Unhealthy

Readiness probe failed: Get "http://10.133.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

ProbeError

Readiness probe error: Get "http://10.133.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-28qvk

Unhealthy

Readiness probe failed: Get "http://10.134.0.24:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

Unhealthy

Readiness probe failed: Get "http://10.133.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

ProbeError

Readiness probe error: Get "http://10.133.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

ProbeError

Readiness probe error: Get "http://10.133.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

Unhealthy

Readiness probe failed: Get "http://10.133.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

ProbeError

Readiness probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

Unhealthy

Readiness probe failed: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

ProbeError

Readiness probe error: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1b634e-548469c467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1b634e-548469c467-llrgw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1b634e-5754895485

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1b634e-5754895485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1b634e: serviceaccount "payload-processing-e2e-api-a-1b634e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1b634e-5754895485

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1b634e-5754895485-wswdk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1b634e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1b634e-548469c467 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1b634e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1b634e-5754895485 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1b634e-548469c467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1b634e-548469c467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1b634e: serviceaccount "payload-processing-e2e-api-a-1b634e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1b634e-548469c467-llrgw

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9cc66e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9cc66e-597bf5b795 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1b634e-548469c467-llrgw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1b634e-548469c467-llrgw

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1b634e-548469c467-llrgw

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9cc66e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9cc66e-75ffd9f5f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9cc66e-75ffd9f5f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9cc66e-75ffd9f5f-kbckr

openshift-ingress

kubelet

payload-processing-e2e-api-a-1b634e-5754895485-wswdk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-1b634e-5754895485-wswdk

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-1b634e-5754895485-wswdk

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9cc66e-75ffd9f5f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9cc66e-75ffd9f5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9cc66e: serviceaccount "payload-processing-e2e-api-a-9cc66e" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-1b634e-5754895485-wswdk

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9cc66e-597bf5b795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9cc66e-597bf5b795-nfjhb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9cc66e-597bf5b795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9cc66e-597bf5b795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9cc66e: serviceaccount "payload-processing-e2e-api-a-9cc66e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9cc66e-597bf5b795-nfjhb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9cc66e-597bf5b795-nfjhb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9cc66e-597bf5b795-nfjhb

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-9cc66e-75ffd9f5f-kbckr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-9cc66e-75ffd9f5f-kbckr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-9cc66e-75ffd9f5f-kbckr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-9cc66e-75ffd9f5f-kbckr

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9cc66e-597bf5b795-nfjhb

Created

Container created

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-nbn54

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 7 to 10

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nbn54

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-nbn54

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-b6b833-openshift-default-8446fb8fcf

SuccessfulCreate

Created pod: e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

openshift-ingress

gateway_labeler_controller

e2e-api-b-b6b833

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b6b833

openshift-ingress

deployment-controller

e2e-api-b-b6b833-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b6b833-openshift-default-8446fb8fcf from 0 to 1

openshift-ingress

multus

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nbn54

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nbn54

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nbn54

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 6.767s (6.767s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nbn54

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nbn54

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b6b833-58bd44c469

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b6b833-58bd44c469-sk2st

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b6b833

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b6b833-66c66b5779 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b6b833

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b6b833-58bd44c469 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b6b833-66c66b5779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b6b833-66c66b5779-846g9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b6b833-58bd44c469

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b6b833-58bd44c469-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b6b833: serviceaccount "payload-processing-e2e-api-b-b6b833" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b6b833-66c66b5779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b6b833-66c66b5779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b6b833: serviceaccount "payload-processing-e2e-api-b-b6b833" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b6b833-66c66b5779-846g9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b6b833-66c66b5779-846g9

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-b6b833-58bd44c469-sk2st

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b6b833-58bd44c469-sk2st

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-b6b833-58bd44c469-sk2st

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-b6b833-58bd44c469-sk2st

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b6b833-66c66b5779-846g9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b6b833-66c66b5779-846g9

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-api-b-0239db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0239db

openshift-ingress

replicaset-controller

e2e-api-b-0239db-openshift-default-5cb4966c67

SuccessfulCreate

Created pod: e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

openshift-ingress

deployment-controller

e2e-api-b-0239db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0239db-openshift-default-5cb4966c67 from 0 to 1

openshift-ingress

multus

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0239db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0239db-86587fc5bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0239db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0239db-568d9557f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0239db-86587fc5bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0239db-86587fc5bc-g5q4n
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0239db-568d9557f7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0239db-568d9557f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0239db: serviceaccount "payload-processing-e2e-api-b-0239db" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0239db-86587fc5bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0239db-86587fc5bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0239db: serviceaccount "payload-processing-e2e-api-b-0239db" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0239db-568d9557f7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0239db-568d9557f7-kv5lz

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0239db-86587fc5bc-g5q4n

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0239db-86587fc5bc-g5q4n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-0239db-568d9557f7-kv5lz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-0239db-568d9557f7-kv5lz

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0239db-86587fc5bc-g5q4n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0239db-86587fc5bc-g5q4n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-0239db-568d9557f7-kv5lz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-0239db-568d9557f7-kv5lz

Created

Container created

openshift-ingress

multus

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

Started

Container started

openshift-ingress

multus

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

Created

Container created

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-1b634e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1b634e-openshift-default-d66ff8bf5 from 1 to 4

openshift-ingress

replicaset-controller

e2e-api-a-1b634e-openshift-default-d66ff8bf5

SuccessfulCreate

Created pod: e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

openshift-ingress

replicaset-controller

e2e-api-a-1b634e-openshift-default-d66ff8bf5

SuccessfulCreate

Created pod: e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1b634e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-1b634e-openshift-default-d66ff8bf5

SuccessfulCreate

Created pod: e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9cc66e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

Created

Container created

openshift-ingress

deployment-controller

e2e-api-a-9cc66e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9cc66e-openshift-default-7757695b65 from 1 to 4

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

Started

Container started

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

Started

Container started

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-a-9cc66e-openshift-default-7757695b65

SuccessfulCreate

Created pod: e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq

openshift-ingress

replicaset-controller

e2e-api-a-9cc66e-openshift-default-7757695b65

SuccessfulCreate

Created pod: e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx

openshift-ingress

replicaset-controller

e2e-api-a-9cc66e-openshift-default-7757695b65

SuccessfulCreate

Created pod: e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

Created

Container created

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx

Created

Container created

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq

Started

Container started

openshift-ingress

multus

e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j

Started

Container started

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j

Created

Container created

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx

Started

Container started

openshift-ingress

multus

e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cb5756cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cb5756cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

Unhealthy

Readiness probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

ProbeError

Readiness probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1b634e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1b634e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9cc66e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9cc66e-597bf5b795-nfjhb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-9cc66e-75ffd9f5f-kbckr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9cc66e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cb5756cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cb5756cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0239db-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0239db-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-a-1b634e-5754895485-wswdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1b634e-548469c467-llrgw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

Unhealthy

Readiness probe failed: Get "http://10.133.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

ProbeError

Readiness probe error: Get "http://10.133.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1b634e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1b634e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9cc66e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9cc66e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

test-curl-11422-41c96c

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

Created

Container created

opendatahub

kubelet

test-curl-11422-41c96c

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x2)

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

Started

Container started

opendatahub

kubelet

test-curl-11422-41c96c

Started

Container started

opendatahub

kubelet

test-curl-11422-41c96c

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.357s (2.357s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11422-41c96c

Created

Container created

opendatahub

kubelet

test-curl-11422-41c96c

Killing

Stopping container test-curl-11422-41c96c
(x7)

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

ProbeError

Startup probe error: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6tqdq

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b6b833-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-wjx8j

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b6b833-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

Unhealthy

Startup probe failed: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-rnm6c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-9cc66e-openshift-default-7757695b65-6nsxx

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-a-1b634e-openshift-default-d66ff8bf5

SuccessfulCreate

Created pod: e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1b634e-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b

Created

Container created

openshift-ingress

deployment-controller

e2e-api-a-1b634e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1b634e-openshift-default-d66ff8bf5 from 4 to 5

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b

Started

Container started
(x3)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-cb5756cb-86dd696cc-jkhdb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-jxnxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-rmf5b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-dw9wx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b6b833-66c66b5779-846g9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b6b833-58bd44c469-sk2st

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-p976w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-j65c5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-1b634e-openshift-default-d66ff8bf5-z5f29

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b6b833-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b6b833-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0239db-86587fc5bc-g5q4n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0239db-568d9557f7-kv5lz

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-api-a-50ac12-openshift-default-65d95897c

SuccessfulCreate

Created pod: e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

openshift-ingress

deployment-controller

e2e-api-a-50ac12-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-50ac12-openshift-default-65d95897c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-50ac12

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-50ac12

openshift-ingress

multus

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-50ac12-56dfcf7975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-50ac12-56dfcf7975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-50ac12: serviceaccount "payload-processing-e2e-api-a-50ac12" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-50ac12-56dfcf7975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-50ac12-56dfcf7975-lr4fc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-50ac12

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-50ac12-56dfcf7975 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-50ac12-776f46ff5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-50ac12-776f46ff5-rrkq5

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-50ac12

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-50ac12-776f46ff5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-50ac12-776f46ff5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-50ac12-776f46ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-50ac12: serviceaccount "payload-processing-e2e-api-a-50ac12" not found
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-jxnxh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-50ac12-56dfcf7975-lr4fc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-50ac12-56dfcf7975-lr4fc

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-cb5756cb-86dd696cc-jkhdb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-api-a-50ac12-776f46ff5-rrkq5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-50ac12-56dfcf7975-lr4fc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x947t

Unhealthy

Readiness probe failed: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x947t

ProbeError

Readiness probe error: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-50ac12-56dfcf7975-lr4fc

Started

Container started

openshift-ingress

kubelet

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

ProbeError

Readiness probe error: Get "http://10.133.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-50ac12-776f46ff5-rrkq5

Started

Container started

openshift-ingress

kubelet

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

Unhealthy

Readiness probe failed: Get "http://10.133.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-api-a-50ac12-776f46ff5-rrkq5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-50ac12-776f46ff5-rrkq5

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-b6b833-openshift-default-8446fb8fcf-z9fxc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

kubelet

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-api-b-0239db-openshift-default-5cb4966c67-nq994

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-sxfk4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cb5756cb-86dd696cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cb5756cb-86dd696cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cb5756cb: serviceaccount "payload-processing-e2e-mt-cb5756cb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cb5756cb: serviceaccount "payload-processing-e2e-mt-cb5756cb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cb5756cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cb5756cb-86dd696cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cb5756cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cb5756cb-7885d746b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cb5756cb-86dd696cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cb5756cb-86dd696cc-pf5db

openshift-ingress

multus

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-sxfk4

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-sxfk4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-cb5756cb-86dd696cc-pf5db

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cb5756cb-86dd696cc-pf5db

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-sxfk4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-cb5756cb-86dd696cc-pf5db

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-cb5756cb-86dd696cc-pf5db

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-sxfk4

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-ea6cc6-openshift-default-6bcf4bd495

SuccessfulCreate

Created pod: e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt

openshift-ingress

gateway_labeler_controller

e2e-api-b-ea6cc6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-ea6cc6

openshift-ingress

deployment-controller

e2e-api-b-ea6cc6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-ea6cc6-openshift-default-6bcf4bd495 from 0 to 1

openshift-ingress

multus

e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ea6cc6-575b4694c7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-ea6cc6-575b4694c7-29mgg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ea6cc6-575b4694c7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-ea6cc6-575b4694c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ea6cc6: serviceaccount "payload-processing-e2e-api-b-ea6cc6" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ea6cc6: serviceaccount "payload-processing-e2e-api-b-ea6cc6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7-8fhxv

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-ea6cc6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-ea6cc6-575b4694c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-ea6cc6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7-8fhxv

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7-8fhxv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7-8fhxv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-ea6cc6-575b4694c7-29mgg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7-8fhxv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-ea6cc6-575b4694c7-29mgg

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-ea6cc6-575b4694c7-29mgg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-ea6cc6-575b4694c7-29mgg

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-9f0694-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9f0694-openshift-default-5d464cbc67 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9f0694

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9f0694

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-03004a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-03004a

openshift-ingress

replicaset-controller

e2e-ipp-a-9f0694-openshift-default-5d464cbc67

SuccessfulCreate

Created pod: e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

openshift-ingress

multus

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-03004a-openshift-default-7f95b97cd7

SuccessfulCreate

Created pod: e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

openshift-ingress

deployment-controller

e2e-ipp-a-03004a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-03004a-openshift-default-7f95b97cd7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-03004a-bb4884467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-03004a-bb4884467-74p5d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9f0694

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9f0694-747879f447 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-03004a-65dc4c599c-n964t

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-03004a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-03004a-65dc4c599c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-03004a-65dc4c599c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-03004a-65dc4c599c-n964t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9f0694-747879f447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9f0694-747879f447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9f0694: serviceaccount "payload-processing-e2e-ipp-a-9f0694" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9f0694-5556cd996f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9f0694-5556cd996f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9f0694: serviceaccount "payload-processing-e2e-ipp-a-9f0694" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9f0694

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9f0694-5556cd996f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-03004a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-03004a-bb4884467 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-03004a-65dc4c599c-n964t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-03004a-bb4884467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-03004a-bb4884467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-03004a: serviceaccount "payload-processing-e2e-ipp-a-03004a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-03004a-65dc4c599c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-03004a-65dc4c599c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-03004a: serviceaccount "payload-processing-e2e-ipp-a-03004a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9f0694-5556cd996f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9f0694-5556cd996f-9tsrp

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-03004a-65dc4c599c-n964t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-03004a-65dc4c599c-n964t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-03004a-bb4884467-74p5d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-03004a-bb4884467-74p5d

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-03004a-bb4884467-74p5d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-5556cd996f-9tsrp

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9f0694-747879f447-5mrn2

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-747879f447-5mrn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-747879f447-5mrn2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-747879f447-5mrn2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-03004a-bb4884467-74p5d

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9f0694-747879f447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9f0694-747879f447-5mrn2

openshift-ingress

multus

payload-processing-e2e-ipp-a-9f0694-5556cd996f-9tsrp

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-50ac12-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-50ac12-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-5556cd996f-9tsrp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.628s (2.628s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-5556cd996f-9tsrp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-5556cd996f-9tsrp

Created

Container created

opendatahub

multus

test-curl-11422-7a414d

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11422-7a414d

Created

Container created

opendatahub

kubelet

test-curl-11422-7a414d

Started

Container started

opendatahub

kubelet

test-curl-11422-7a414d

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-11422-7a414d

Killing

Stopping container test-curl-11422-7a414d

openshift-ingress

kubelet

payload-processing-e2e-mt-cb5756cb-86dd696cc-pf5db

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb5756cb-7885d746b7-sxfk4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-03004a-65dc4c599c-n964t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-03004a-bb4884467-74p5d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-747879f447-5mrn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-5556cd996f-9tsrp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-50ac12-56dfcf7975-lr4fc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-50ac12-776f46ff5-rrkq5

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-03004a: serviceaccount "payload-processing-e2e-ipp-a-03004a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-03004a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-03004a-5d58b9c94

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-03004a-5d58b9c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-03004a: serviceaccount "payload-processing-e2e-ipp-a-03004a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-03004a-5d58b9c94

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-03004a-5d58b9c94-bzv99

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-03004a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-03004a-5d58b9c94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-fwfh4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9f0694

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9f0694: serviceaccount "payload-processing-e2e-ipp-a-9f0694" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-plspb

openshift-ingress

multus

payload-processing-e2e-ipp-a-03004a-5d58b9c94-bzv99

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-fwfh4

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-fwfh4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9f0694-58c7447fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9f0694-58c7447fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9f0694-58c7447fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9f0694: serviceaccount "payload-processing-e2e-ipp-a-9f0694" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9f0694

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9f0694-58c7447fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-03004a-5d58b9c94-bzv99

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-747879f447-5mrn2

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.108:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-plspb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-plspb

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-fwfh4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-plspb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.689s (1.69s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-plspb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-plspb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-fwfh4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.832s (2.832s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-fwfh4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-03004a-5d58b9c94-bzv99

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-03004a-5d58b9c94-bzv99

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-03004a-5d58b9c94-bzv99

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.735s (2.735s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.237s (2.237s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ea6cc6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ea6cc6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-50ac12-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-50ac12-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-cb5756cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cb5756cb-openshift-default-9785d8d5c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cb5756cb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-cb5756cb-openshift-default-9785d8d5c

SuccessfulCreate

Created pod: e2e-mt-cb5756cb-openshift-default-9785d8d5c-jwp5s

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-jwp5s

Started

Container started

openshift-ingress

multus

e2e-mt-cb5756cb-openshift-default-9785d8d5c-jwp5s

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-jwp5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-jwp5s

Created

Container created

openshift-ingress

kubelet

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-50ac12-openshift-default-65d95897c-ljcll

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-40a891

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-40a891

openshift-ingress

deployment-controller

e2e-ipp-b-40a891-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-40a891-openshift-default-74488b79bc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-40a891-openshift-default-74488b79bc

SuccessfulCreate

Created pod: e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

openshift-ingress

multus

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

Unhealthy

Readiness probe failed: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

ProbeError

Readiness probe error: Get "http://10.133.0.136:15021/healthz/ready": read tcp 10.133.0.2:44510->10.133.0.136:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

Unhealthy

Readiness probe failed: Get "http://10.133.0.136:15021/healthz/ready": read tcp 10.133.0.2:44510->10.133.0.136:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

ProbeError

Readiness probe error: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ea6cc6-66f9dc7bb7-8fhxv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ea6cc6-575b4694c7-29mgg

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-40a891-7d847948c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-40a891-7d847948c9-sxfw9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-40a891-7d847948c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-40a891-7d847948c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-40a891: serviceaccount "payload-processing-e2e-ipp-b-40a891" not found

openshift-ingress

deployment-controller

e2e-ipp-b-cbbaec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-cbbaec-openshift-default-686f7db48f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-cbbaec-openshift-default-686f7db48f

SuccessfulCreate

Created pod: e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-40a891

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-40a891-7d847948c9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-cbbaec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-cbbaec
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-40a891-b4565c8b9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-40a891-b4565c8b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-40a891: serviceaccount "payload-processing-e2e-ipp-b-40a891" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-40a891-b4565c8b9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-40a891-b4565c8b9-h4chg

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-40a891

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-40a891-b4565c8b9 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-40a891-b4565c8b9-h4chg

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-40a891-7d847948c9-sxfw9

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40a891-7d847948c9-sxfw9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40a891-7d847948c9-sxfw9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40a891-b4565c8b9-h4chg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40a891-7d847948c9-sxfw9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40a891-b4565c8b9-h4chg

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

Unhealthy

Startup probe failed: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40a891-b4565c8b9-h4chg

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

ProbeError

Startup probe error: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cbbaec: serviceaccount "payload-processing-e2e-ipp-b-cbbaec" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c-fnzlr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-cbbaec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-cbbaec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-cbbaec-7465d947c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cbbaec-7465d947c5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-cbbaec-7465d947c5-7h4qd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cbbaec-7465d947c5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-cbbaec-7465d947c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cbbaec: serviceaccount "payload-processing-e2e-ipp-b-cbbaec" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c-fnzlr

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbbaec-7465d947c5-7h4qd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c-fnzlr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbbaec-7465d947c5-7h4qd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c-fnzlr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbbaec-7465d947c5-7h4qd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c-fnzlr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-cbbaec-7465d947c5-7h4qd

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9f0694-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-03004a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-03004a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9f0694-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ea6cc6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ea6cc6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40a891-7d847948c9-sxfw9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40a891-b4565c8b9-h4chg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-ea6cc6-openshift-default-6bcf4bd495-vrwzt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-073e24

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-073e24

openshift-ingress

deployment-controller

e2e-ipp-a-073e24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-073e24-openshift-default-5d47c5496f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-073e24-openshift-default-5d47c5496f

SuccessfulCreate

Created pod: e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

openshift-ingress

multus

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-40a891: serviceaccount "payload-processing-e2e-ipp-b-40a891" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-40a891-674fcbf5bb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-40a891-674fcbf5bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-40a891: serviceaccount "payload-processing-e2e-ipp-b-40a891" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7-frvx4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-40a891

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-40a891

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-40a891-674fcbf5bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-40a891-674fcbf5bb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-40a891-674fcbf5bb-7zs82

openshift-ingress

multus

payload-processing-e2e-ipp-b-40a891-674fcbf5bb-7zs82

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40a891-674fcbf5bb-7zs82

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7-frvx4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7-frvx4

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7-frvx4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7-frvx4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40a891-674fcbf5bb-7zs82

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40a891-674fcbf5bb-7zs82

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-03004a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9f0694-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-03004a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9f0694-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-073e24

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbbaec-7465d947c5-7h4qd

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-073e24: serviceaccount "payload-processing-e2e-ipp-a-073e24" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-073e24

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-073e24-84448c64c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f-jff2m

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-073e24-84448c64c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-073e24-84448c64c-2cs2g
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-073e24-84448c64c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-073e24-84448c64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-073e24: serviceaccount "payload-processing-e2e-ipp-a-073e24" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbbaec-5fbf9d6d6c-fnzlr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f-jff2m

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f-jff2m

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-073e24-84448c64c-2cs2g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-073e24-84448c64c-2cs2g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-073e24-84448c64c-2cs2g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f-jff2m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-073e24-84448c64c-2cs2g

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f-jff2m

Started

Container started

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-jwp5s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cb5756cb-openshift-default-9785d8d5c-598zd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-676801-openshift-default-d68754d77

SuccessfulCreate

Created pod: e2e-api-a-676801-openshift-default-d68754d77-nljqb

openshift-ingress

gateway_labeler_controller

e2e-api-a-676801

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-676801

openshift-ingress

deployment-controller

e2e-api-a-676801-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-676801-openshift-default-d68754d77 from 0 to 1

openshift-ingress

multus

e2e-api-a-676801-openshift-default-d68754d77-nljqb

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-cbbaec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cbbaec: serviceaccount "payload-processing-e2e-ipp-b-cbbaec" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cbbaec: serviceaccount "payload-processing-e2e-ipp-b-cbbaec" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9-xdm8b

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4-c6wrn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-cbbaec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9-xdm8b

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9-xdm8b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4-c6wrn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9-xdm8b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4-c6wrn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4-c6wrn

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4-c6wrn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9-xdm8b

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-676801

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-676801-b8f7487cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-676801-84b8cddcf

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-676801-84b8cddcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-676801: serviceaccount "payload-processing-e2e-api-a-676801" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-676801-84b8cddcf

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-676801-84b8cddcf-fm7th

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-676801

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-676801-84b8cddcf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-676801-b8f7487cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-676801-b8f7487cf-cgkdl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-676801-b8f7487cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-676801-b8f7487cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-676801: serviceaccount "payload-processing-e2e-api-a-676801" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-676801-84b8cddcf-fm7th

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-676801-b8f7487cf-cgkdl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-676801-b8f7487cf-cgkdl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-676801-b8f7487cf-cgkdl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-676801-b8f7487cf-cgkdl

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-676801-84b8cddcf-fm7th

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-676801-84b8cddcf-fm7th

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-676801-84b8cddcf-fm7th

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-073e24-d6d5c769f-jff2m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

Unhealthy

Readiness probe failed: Get "http://10.133.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-073e24-84448c64c-2cs2g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

ProbeError

Readiness probe error: Get "http://10.133.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cbbaec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cbbaec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-073e24-6587d56cd4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-073e24-6587d56cd4-zd2wp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-073e24-6587d56cd4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-073e24-6587d56cd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-073e24: serviceaccount "payload-processing-e2e-ipp-a-073e24" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-073e24: serviceaccount "payload-processing-e2e-ipp-a-073e24" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-073e24

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-073e24-6587d56cd4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-nrqpl
(x6)

openshift-ingress

kubelet

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-073e24

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-073e24-6587d56cd4-zd2wp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-073e24-6587d56cd4-zd2wp

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-073e24-6587d56cd4-zd2wp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-nrqpl

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-073e24-6587d56cd4-zd2wp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-nrqpl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

gateway_labeler_controller

e2e-api-b-e52ba1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-e52ba1

openshift-ingress

deployment-controller

e2e-api-b-e52ba1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-e52ba1-openshift-default-845b6c8d4c from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-e52ba1-openshift-default-845b6c8d4c

SuccessfulCreate

Created pod: e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td

openshift-ingress

multus

e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-nrqpl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-nrqpl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-nrqpl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.366s (2.366s including waiting). Image size: 166620835 bytes.

openshift-ingress

multus

payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f-2bgww

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-e52ba1-6ff49f9b65-fkztl

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e52ba1-6ff49f9b65

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-e52ba1-6ff49f9b65-fkztl

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-e52ba1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-e52ba1-6ff49f9b65 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-e52ba1-6ff49f9b65-fkztl

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-e52ba1-6ff49f9b65-fkztl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-e52ba1-6ff49f9b65-fkztl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f-2bgww

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e52ba1-6ff49f9b65

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-e52ba1-6ff49f9b65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e52ba1: serviceaccount "payload-processing-e2e-api-b-e52ba1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-e52ba1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f-2bgww
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e52ba1: serviceaccount "payload-processing-e2e-api-b-e52ba1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f-2bgww

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f-2bgww

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cbbaec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cbbaec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-9f0694

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-9f0694: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-9f0694": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-9f0694, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dd04ab76-efa4-4829-b12d-c1615831503d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f0694-58c7447fd-sqmcm

Unhealthy

Readiness probe failed: dial tcp 10.132.0.102:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f0694-867ff7997f-plspb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

ProbeError

Readiness probe error: Get "http://10.133.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

Unhealthy

Readiness probe failed: Get "http://10.133.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-90c4d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-90c4d1
(x2)

openshift-ingress

kubelet

e2e-api-a-676801-openshift-default-d68754d77-nljqb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-676801-openshift-default-d68754d77-nljqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-ipp-b-90c4d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7

SuccessfulCreate

Created pod: e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn
(x2)

openshift-ingress

kubelet

e2e-api-a-676801-openshift-default-d68754d77-nljqb

Started

Container started

openshift-ingress

multus

e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-9f0694-openshift-default-5d464cbc67-47sm6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9-f2b7h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-90c4d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-90c4d1: serviceaccount "payload-processing-e2e-ipp-b-90c4d1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-90c4d1: serviceaccount "payload-processing-e2e-ipp-b-90c4d1" not found
(x6)

openshift-ingress

kubelet

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87-472dh

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-90c4d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9-f2b7h

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9-f2b7h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9-f2b7h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87-472dh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87-472dh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87-472dh

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9-f2b7h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87-472dh

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-api-a-676801-openshift-default-d68754d77-nljqb

Unhealthy

Startup probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-676801-openshift-default-d68754d77-nljqb

ProbeError

Startup probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-40a891-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-40a891-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-676801-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-676801-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbbaec-785bd5dfb4-c6wrn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbbaec-7b746747f9-xdm8b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-676801-b8f7487cf-cgkdl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-676801-84b8cddcf-fm7th

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-cbbaec-openshift-default-686f7db48f-s76j2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-a779b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-a779b3

openshift-ingress

replicaset-controller

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df

SuccessfulCreate

Created pod: e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb

openshift-ingress

deployment-controller

e2e-praxis-a-a779b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-90c4d1-68b4f57f87-472dh

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-611693

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-611693

openshift-ingress

multus

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-90c4d1-74cfd6d8b9-f2b7h

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-a-611693-openshift-default-7c79c8b6c7

SuccessfulCreate

Created pod: e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j
(x2)

openshift-ingress

kubelet

e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-a-611693-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-611693-openshift-default-7c79c8b6c7 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-676801-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-90c4d1: serviceaccount "payload-processing-e2e-ipp-b-90c4d1" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-676801-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-90c4d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-90c4d1-cc54c76d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-90c4d1-cc54c76d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-90c4d1-cc54c76d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-90c4d1: serviceaccount "payload-processing-e2e-ipp-b-90c4d1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-90c4d1-cc54c76d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-90c4d1-cc54c76d6-d4bb8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-90c4d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-a779b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7-h8xrt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a779b3: serviceaccount "payload-processing-e2e-praxis-a-a779b3" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-90c4d1-cc54c76d6-d4bb8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-90c4d1-cc54c76d6-d4bb8

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-a779b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-a779b3-55f94f74f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-pn828
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a779b3-55f94f74f7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-a779b3-55f94f74f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a779b3: serviceaccount "payload-processing-e2e-praxis-a-a779b3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a779b3-55f94f74f7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-a779b3-55f94f74f7-lckxk

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-pn828

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-a779b3-55f94f74f7-lckxk

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-611693

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-611693-659f7dbbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-611693-659f7dbbc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-611693-659f7dbbc-nv5rn

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7-h8xrt

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7-h8xrt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7-h8xrt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7-h8xrt

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-611693-659f7dbbc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-611693-659f7dbbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-611693: serviceaccount "payload-processing-e2e-praxis-a-611693" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a779b3-55f94f74f7-lckxk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-pn828

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-pn828

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-pn828

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-611693

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-611693-7fcd9546c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-90c4d1-cc54c76d6-d4bb8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-90c4d1-cc54c76d6-d4bb8

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-611693-7fcd9546c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-611693-7fcd9546c-sz9nm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-611693-7fcd9546c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-611693-7fcd9546c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-611693: serviceaccount "payload-processing-e2e-praxis-a-611693" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a779b3-55f94f74f7-lckxk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a779b3-55f94f74f7-lckxk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-611693-659f7dbbc-nv5rn

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-611693-7fcd9546c-sz9nm

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-611693-7fcd9546c-sz9nm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td

ProbeError

Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-611693-659f7dbbc-nv5rn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td

Unhealthy

Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-611693-659f7dbbc-nv5rn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-611693-7fcd9546c-sz9nm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-611693-7fcd9546c-sz9nm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-611693-659f7dbbc-nv5rn

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-073e24-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-073e24-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulDelete

Deleted pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-q47tl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulDelete

Deleted pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-nd2rf

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a779b3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a779b3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e52ba1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e52ba1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sxwm8

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-r8lmx

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-rtjb4

openshift-ingress

kubelet

e2e-api-a-676801-openshift-default-d68754d77-nljqb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-676801-openshift-default-d68754d77-nljqb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-676801-openshift-default-d68754d77-nljqb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-chwsm
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e52ba1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-chwsm

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-chwsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e52ba1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-chwsm

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-chwsm

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-chwsm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-chwsm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-726dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-726dd1-openshift-default-65bdbcc949 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e52ba1-f76cdc67f-2bgww

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-c06ae4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-c06ae4

openshift-ingress

kubelet

payload-processing-e2e-api-b-e52ba1-6ff49f9b65-fkztl

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-praxis-b-726dd1-openshift-default-65bdbcc949

SuccessfulCreate

Created pod: e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-726dd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-726dd1

openshift-ingress

replicaset-controller

e2e-praxis-b-c06ae4-openshift-default-5448bdf45c

SuccessfulCreate

Created pod: e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t

openshift-ingress

deployment-controller

e2e-praxis-b-c06ae4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c06ae4-openshift-default-5448bdf45c from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:

openshift-ingress

multus

e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-a-073e24

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-a-073e24: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-a-073e24": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-a-073e24, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 012dd7ee-7a4d-4f18-ab7e-1f476357d7bf, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-073e24-6587d56cd4-zd2wp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-073e24-96b5fbc75-nrqpl

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579-hps4q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-726dd1: serviceaccount "payload-processing-e2e-praxis-b-726dd1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-726dd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-726dd1-76dc5b5477 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-726dd1-76dc5b5477

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-726dd1-76dc5b5477-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-726dd1: serviceaccount "payload-processing-e2e-praxis-b-726dd1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-726dd1-76dc5b5477

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-726dd1-76dc5b5477-drjkc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-726dd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-726dd1-76dc5b5477-drjkc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-c06ae4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-c06ae4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5-nw9bs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c06ae4: serviceaccount "payload-processing-e2e-praxis-b-c06ae4" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-726dd1-76dc5b5477-drjkc

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95-2vgf7

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-726dd1-76dc5b5477-drjkc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579-hps4q

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c06ae4: serviceaccount "payload-processing-e2e-praxis-b-c06ae4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579-hps4q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579-hps4q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579-hps4q

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-726dd1-76dc5b5477-drjkc

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5-nw9bs

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5-nw9bs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95-2vgf7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5-nw9bs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5-nw9bs

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95-2vgf7

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulDelete

Deleted pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j48ql

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulDelete

Deleted pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95-2vgf7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95-2vgf7

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-wpqq5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dlngr

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 10 to 7

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kvnjl

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-bl8fj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-073e24-openshift-default-5d47c5496f-r6xpr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-90c4d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-90c4d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

Unhealthy

Readiness probe failed: Get "http://10.133.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

ProbeError

Readiness probe error: Get "http://10.133.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-xrg6p

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-28fqd

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-90c4d1-cc54c76d6-d4bb8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-90c4d1-d575b4cd7-h8xrt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-e52ba1-openshift-default-845b6c8d4c-v78td

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

Unhealthy

Startup probe failed: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

ProbeError

Startup probe error: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb

ProbeError

Startup probe error: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-611693-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb

Unhealthy

Startup probe failed: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-a3ff0c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a3ff0c-openshift-default-65b548b59c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-a3ff0c-openshift-default-65b548b59c

SuccessfulCreate

Created pod: e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-611693-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a3ff0c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a3ff0c
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-90c4d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-90c4d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a3ff0c: serviceaccount "payload-processing-e2e-ipp-a-a3ff0c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a3ff0c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5-6rlkd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a3ff0c: serviceaccount "payload-processing-e2e-ipp-a-a3ff0c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a3ff0c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5-76q9t

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5-76q9t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5-76q9t

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5-76q9t

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5-76q9t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-90c4d1-openshift-default-ddcf89cb7-zj6cn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5-6rlkd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5-6rlkd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5-6rlkd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5-6rlkd

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-b8d890

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-b8d890

openshift-ingress

deployment-controller

e2e-praxis-a-b8d890-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b8d890-openshift-default-7c5f6b7449 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449

SuccessfulCreate

Created pod: e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

openshift-ingress

multus

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a779b3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a779b3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b8d890-76f99c4c5c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-b8d890-76f99c4c5c-r8p4t

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-611693-7fcd9546c-sz9nm

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf-pvfnp

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-b8d890

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-b8d890-76f99c4c5c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-b8d890

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b8d890-76f99c4c5c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-b8d890-76f99c4c5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b8d890: serviceaccount "payload-processing-e2e-praxis-a-b8d890" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-611693-659f7dbbc-nv5rn

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b8d890: serviceaccount "payload-processing-e2e-praxis-a-b8d890" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf-pvfnp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf-pvfnp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-b8d890-76f99c4c5c-r8p4t

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf-pvfnp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b8d890-76f99c4c5c-r8p4t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf-pvfnp

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b8d890-76f99c4c5c-r8p4t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b8d890-76f99c4c5c-r8p4t

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-611693-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-611693-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c06ae4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c06ae4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-03004a-f9866d4cf-fwfh4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-03004a-5d58b9c94-bzv99

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t

ProbeError

Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t

Unhealthy

Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr

ProbeError

Startup probe error: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr

Unhealthy

Startup probe failed: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a3ff0c-d9ffcbff5-76q9t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a3ff0c-68cf79bdf5-6rlkd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-611693-openshift-default-7c79c8b6c7-k568j

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-726dd1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-726dd1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c06ae4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c06ae4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a3ff0c-5f649767d8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a3ff0c-5f649767d8-gq9xs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a3ff0c-5f649767d8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a3ff0c-5f649767d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a3ff0c: serviceaccount "payload-processing-e2e-ipp-a-a3ff0c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a3ff0c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a3ff0c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a3ff0c-5f649767d8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a3ff0c: serviceaccount "payload-processing-e2e-ipp-a-a3ff0c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc-db4vr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc-db4vr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-278a56-openshift-default-67447b54b5

SuccessfulCreate

Created pod: e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

openshift-ingress

deployment-controller

e2e-praxis-b-278a56-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-278a56-openshift-default-67447b54b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-278a56

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-278a56

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc-db4vr

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a3ff0c-5f649767d8-gq9xs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a3ff0c-5f649767d8-gq9xs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c06ae4-85bbdc8b95-2vgf7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc-db4vr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc-db4vr

Created

Container created

openshift-ingress

multus

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a3ff0c-5f649767d8-gq9xs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-a3ff0c-5f649767d8-gq9xs

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c06ae4-6c7b457f5-nw9bs

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-praxis-b-c06ae4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-praxis-b-c06ae4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-praxis-b-c06ae4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-praxis-b-c06ae4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 03fa4a2b-3d53-40e6-b136-8e3c0724d437, UID in object meta:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-278a56-786645f87f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-278a56-786645f87f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-278a56: serviceaccount "payload-processing-e2e-praxis-b-278a56" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b8d890-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-278a56-b55dfbf6c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-278a56-b55dfbf6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-278a56: serviceaccount "payload-processing-e2e-praxis-b-278a56" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-278a56

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-278a56-b55dfbf6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-278a56-786645f87f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-278a56-786645f87f-jdwft
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b8d890-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-278a56-b55dfbf6c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-278a56-b55dfbf6c-wl4xf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-278a56

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-278a56-786645f87f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-278a56-786645f87f-jdwft

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-278a56-786645f87f-jdwft

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-278a56-b55dfbf6c-wl4xf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-278a56-b55dfbf6c-wl4xf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-278a56-786645f87f-jdwft

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-278a56-786645f87f-jdwft

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-278a56-b55dfbf6c-wl4xf

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-278a56-b55dfbf6c-wl4xf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-c06ae4-openshift-default-5448bdf45c-fqw8t

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-726dd1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-726dd1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq

Unhealthy

Startup probe failed: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq

ProbeError

Startup probe error: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-925bac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-925bac

openshift-ingress

deployment-controller

e2e-ipp-b-925bac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-925bac-openshift-default-6846b8897c from 0 to 1

openshift-ingress

multus

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-925bac-openshift-default-6846b8897c

SuccessfulCreate

Created pod: e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-925bac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-925bac-67c8b68c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-925bac-67c8b68c9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-925bac-67c8b68c9-j7xf7
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-925bac-67c8b68c9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-925bac-67c8b68c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-925bac: serviceaccount "payload-processing-e2e-ipp-b-925bac" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-925bac: serviceaccount "payload-processing-e2e-ipp-b-925bac" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-925bac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-925bac-67c8b68c9-j7xf7

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5-2t4h6

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-925bac-67c8b68c9-j7xf7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-925bac-67c8b68c9-j7xf7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-925bac-67c8b68c9-j7xf7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5-2t4h6

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5-2t4h6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5-2t4h6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5-2t4h6

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df

SuccessfulCreate

Created pod: e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a779b3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-a779b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df from 1 to 2

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd

Created

Container created

openshift-ingress

multus

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a3ff0c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a3ff0c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd

ProbeError

Startup probe error: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd

Unhealthy

Startup probe failed: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-925bac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-925bac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449

SuccessfulCreate

Created pod: e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b8d890-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-03004a-openshift-default-7f95b97cd7-rcppp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449

SuccessfulCreate

Created pod: e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-b8d890-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b8d890-openshift-default-7c5f6b7449 from 1 to 3

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b8d890-76f99c4c5c-r8p4t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b8d890-7588c66bcf-pvfnp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

Unhealthy

Readiness probe failed: Get "http://10.133.0.175:15021/healthz/ready": read tcp 10.133.0.2:47026->10.133.0.175:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

ProbeError

Readiness probe error: Get "http://10.133.0.175:15021/healthz/ready": read tcp 10.133.0.2:47026->10.133.0.175:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt

ProbeError

Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt

Unhealthy

Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a3ff0c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a3ff0c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

Unhealthy

Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

ProbeError

Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-msc7p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-d9vlt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-925bac-67c8b68c9-j7xf7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-praxis-a-b8d890-openshift-default-dockercfg-fvs7g); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-925bac-5f4fc787c5-2t4h6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-b8d890-openshift-default-7c5f6b7449-v48p4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-925bac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-925bac-5c47f5688d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-925bac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-925bac-76cc94458c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-925bac-76cc94458c-lffmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-925bac-76cc94458c-lffmd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-40a891-68c7d596d7-frvx4

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-40a891

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-40a891: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-40a891": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-40a891, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eed97e6d-11bb-4bd8-a2f1-cc6253fd195f, UID in object meta:

openshift-ingress

multus

payload-processing-e2e-ipp-b-925bac-5c47f5688d-qwwc5

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-925bac-5c47f5688d-qwwc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-925bac-5c47f5688d-qwwc5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-925bac-5c47f5688d-qwwc5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-925bac-76cc94458c-lffmd

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-40a891-674fcbf5bb-7zs82

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-925bac-76cc94458c-lffmd

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-925bac-76cc94458c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-925bac-76cc94458c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-925bac: serviceaccount "payload-processing-e2e-ipp-b-925bac" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-925bac-5c47f5688d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-925bac-5c47f5688d-qwwc5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-925bac-76cc94458c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-925bac-76cc94458c-lffmd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-925bac-5c47f5688d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-925bac-5c47f5688d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-925bac: serviceaccount "payload-processing-e2e-ipp-b-925bac" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 8 to 10

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-278a56-786645f87f-jdwft

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-278a56-b55dfbf6c-wl4xf

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-278a56-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-278a56-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-40a891-openshift-default-74488b79bc-6xff5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-5f65e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-5f65e1

openshift-ingress

deployment-controller

e2e-praxis-a-5f65e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f

SuccessfulCreate

Created pod: e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-925bac-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-925bac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-925bac-openshift-default-6846b8897c from 1 to 3

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-b-925bac-openshift-default-6846b8897c

SuccessfulCreate

Created pod: e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6

openshift-ingress

multus

e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-925bac-openshift-default-6846b8897c

SuccessfulCreate

Created pod: e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

Unhealthy

Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

ProbeError

Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

ProbeError

Startup probe error: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

Unhealthy

Startup probe failed: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

Unhealthy

Readiness probe failed: Get "http://10.133.0.181:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

ProbeError

Readiness probe error: Get "http://10.133.0.181:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-5f65e1-57d7b54575

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-5f65e1-57d7b54575-2mxkk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5-84wdf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-5f65e1: serviceaccount "payload-processing-e2e-praxis-a-5f65e1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-5f65e1-57d7b54575

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-5f65e1-57d7b54575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-5f65e1: serviceaccount "payload-processing-e2e-praxis-a-5f65e1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-5f65e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-5f65e1-57d7b54575 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-5f65e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5-84wdf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-5f65e1-57d7b54575-2mxkk

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a779b3-55f94f74f7-lckxk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5f65e1-57d7b54575-2mxkk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5-84wdf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5-84wdf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-pn828

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5f65e1-57d7b54575-2mxkk

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-a-a779b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a779b3-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5f65e1-57d7b54575-2mxkk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5-84wdf

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df

SuccessfulCreate

Created pod: e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74

openshift-ingress

multus

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6

ProbeError

Startup probe error: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6

Unhealthy

Startup probe failed: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-278a56-openshift-default-67447b54b5-74kf4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

ProbeError

Startup probe error: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

Unhealthy

Startup probe failed: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a779b3-5d8fff9cc9-pn828

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a779b3-55f94f74f7-lckxk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a3ff0c-6f5899b7bc-db4vr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a3ff0c-5f649767d8-gq9xs

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-praxis-b-77e2b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-77e2b5-openshift-default-64bb746b49 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-77e2b5-openshift-default-64bb746b49

SuccessfulCreate

Created pod: e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-77e2b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-77e2b5

openshift-ingress

multus

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-925bac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-925bac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-a3ff0c-openshift-default-65b548b59c-sqjlq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-77e2b5-649795fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-77e2b5-649795fff-jtszw

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-77e2b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-77e2b5-6f96567b7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-77e2b5-6f96567b7c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-77e2b5-6f96567b7c-qdkcz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-77e2b5-6f96567b7c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-77e2b5-6f96567b7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-77e2b5: serviceaccount "payload-processing-e2e-praxis-b-77e2b5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-77e2b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-77e2b5-649795fff from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-77e2b5-649795fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-77e2b5-649795fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-77e2b5: serviceaccount "payload-processing-e2e-praxis-b-77e2b5" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-77e2b5-6f96567b7c-qdkcz

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-77e2b5-649795fff-jtszw

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-77e2b5-649795fff-jtszw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-77e2b5-649795fff-jtszw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-77e2b5-649795fff-jtszw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-77e2b5-6f96567b7c-qdkcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-77e2b5-6f96567b7c-qdkcz

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulDelete

Deleted pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-77e2b5-6f96567b7c-qdkcz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-6xwsg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 8 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6k8js

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-6k8js
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5f65e1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5f65e1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx

Unhealthy

Startup probe failed: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx

ProbeError

Startup probe error: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 7 to 10
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-925bac-76cc94458c-lffmd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

Created

Container created

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

Started

Container started

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-925bac-5c47f5688d-qwwc5

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-praxis-a-a779b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a779b3-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df

SuccessfulCreate

Created pod: e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v

openshift-ingress

replicaset-controller

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df

SuccessfulCreate

Created pod: e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-p6jpj

openshift-ingress

multus

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-t4mgd

Unhealthy

Readiness probe failed: Get "https://10.133.0.27:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-p6jpj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

ProbeError

Startup probe error: Get "http://10.133.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

Unhealthy

Startup probe failed: Get "http://10.133.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-p6jpj

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-p6jpj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-p6jpj

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5f65e1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5f65e1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-jcb6f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-8spj6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-eb8ae6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-eb8ae6

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-925bac-openshift-default-6846b8897c-n9p22

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-praxis-a-eb8ae6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7

SuccessfulCreate

Created pod: e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w

openshift-ingress

multus

e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes
(x12)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

ProbeError

Startup probe error: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

Unhealthy

Startup probe failed: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

ProbeError

Startup probe error: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

Unhealthy

Startup probe failed: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-eb8ae6: serviceaccount "payload-processing-e2e-praxis-a-eb8ae6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-eb8ae6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-eb8ae6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c-g4knv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff-d4rl4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-eb8ae6: serviceaccount "payload-processing-e2e-praxis-a-eb8ae6" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c-g4knv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c-g4knv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff-d4rl4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff-d4rl4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff-d4rl4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff-d4rl4

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c-g4knv

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c-g4knv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5f65e1-57d7b54575-2mxkk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5f65e1-5dc87f69f5-84wdf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-q9ztb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-znq74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-9wstd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-p6jpj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-a779b3-openshift-default-5f9c9bb6df-pll4v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

ProbeError

Startup probe error: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

Unhealthy

Startup probe failed: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-5f65e1-openshift-default-5999bfbc6f-8skgx

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-77e2b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-77e2b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-dbff33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-dbff33

openshift-ingress

deployment-controller

e2e-praxis-b-dbff33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-dbff33-openshift-default-6d66d88fb5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5

SuccessfulCreate

Created pod: e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

openshift-ingress

multus

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-77e2b5-649795fff-jtszw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-77e2b5-6f96567b7c-qdkcz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-726dd1-76dc5b5477-drjkc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-726dd1-644c6bb579-hps4q

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-eb8ae6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-eb8ae6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-dbff33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-dbff33-5d5dfd769c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-dbff33: serviceaccount "payload-processing-e2e-praxis-b-dbff33" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-dbff33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-bjfqm
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-dbff33-5d5dfd769c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-dbff33: serviceaccount "payload-processing-e2e-praxis-b-dbff33" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-dbff33-5d5dfd769c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-l7jmh

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-l7jmh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-bjfqm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-bjfqm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-bjfqm

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-bjfqm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-l7jmh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-l7jmh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-l7jmh

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-dwb9j

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 7 to 6

openshift-ingress

kubelet

e2e-praxis-b-726dd1-openshift-default-65bdbcc949-wnczr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-77e2b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-77e2b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-77e2b5-openshift-default-64bb746b49-6hm8p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

Unhealthy

Readiness probe failed: Get "http://10.133.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

ProbeError

Readiness probe error: Get "http://10.133.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-ed4dce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-ed4dce

openshift-ingress

deployment-controller

e2e-shared-a-w2-ed4dce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f

SuccessfulCreate

Created pod: e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m

openshift-ingress

multus

e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-rbssh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-b4stk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ed4dce: serviceaccount "payload-processing-e2e-shared-a-w2-ed4dce" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ed4dce: serviceaccount "payload-processing-e2e-shared-a-w2-ed4dce" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-ed4dce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7 from 0 to 1

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

ProbeError

Readiness probe error: Get "http://10.134.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

Unhealthy

Readiness probe failed: Get "http://10.134.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-ed4dce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-b4stk

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-b4stk

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-rbssh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-b4stk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-rbssh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-rbssh

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-b4stk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-rbssh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

ProbeError

Startup probe error: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

Unhealthy

Startup probe failed: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-eb8ae6-cf677f7ff-d4rl4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-eb8ae6-7789f8f95c-g4knv

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-dbff33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-dbff33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df

SuccessfulCreate

Created pod: e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-cfzj2

Unhealthy

Readiness probe failed: Get "https://10.133.0.28:8000/ready": context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-46a67e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-46a67e

openshift-ingress

deployment-controller

e2e-shared-a-w4-46a67e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df from 0 to 1

openshift-ingress

multus

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-eb8ae6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-eb8ae6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-eb8ae6-openshift-default-7c44cd8cf7-vnj4w

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-46a67e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-46a67e: serviceaccount "payload-processing-e2e-shared-a-w4-46a67e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-46a67e: serviceaccount "payload-processing-e2e-shared-a-w4-46a67e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-rf4s6

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-bnd5g

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-46a67e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-rf4s6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-bnd5g

Created

Container created

openshift-ingress

multus

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

AddedInterface

Add eth0 [10.133.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-rf4s6

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-a-w3-7a850e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-rf4s6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-rf4s6

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-bnd5g

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-bnd5g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-7a850e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-7a850e

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-bnd5g

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f

SuccessfulCreate

Created pod: e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5

SuccessfulCreate

Created pod: e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

openshift-ingress

deployment-controller

e2e-shared-b-w2-2e6bfd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-mwxgr

openshift-ingress

multus

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-2e6bfd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-2e6bfd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-7a850e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-7a850e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7a850e: serviceaccount "payload-processing-e2e-shared-a-w3-7a850e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7a850e: serviceaccount "payload-processing-e2e-shared-a-w3-7a850e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-mwxgr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-mwxgr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-8w2q2

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-8w2q2

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-8w2q2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-8w2q2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-mwxgr

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-mwxgr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-8w2q2

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-dbff33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-dbff33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-l7jmh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-bjfqm

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7-zj4nw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447-w877l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-2e6bfd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-2e6bfd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2e6bfd: serviceaccount "payload-processing-e2e-shared-b-w2-2e6bfd" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2e6bfd: serviceaccount "payload-processing-e2e-shared-b-w2-2e6bfd" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-6d7f5d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-6d7f5d

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 8 to 10

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447-w877l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7-zj4nw

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447-w877l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7-zj4nw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7-zj4nw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulCreate

Created pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447-w877l

AddedInterface

Add eth0 [10.133.0.224/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447-w877l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7-zj4nw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w0-6d7f5d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c

SuccessfulCreate

Created pod: e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

Started

Container started

openshift-ingress

multus

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw

AddedInterface

Add eth0 [10.133.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw

Created

Container created

openshift-ingress

multus

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

AddedInterface

Add eth0 [10.133.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-dbff33-5db9c986f9-bjfqm

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.210:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

ProbeError

Readiness probe error: Get "http://10.133.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-dbff33-5d5dfd769c-l7jmh

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.155:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

Unhealthy

Readiness probe failed: Get "http://10.133.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-7cg9w

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-6d7f5d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 6 to 5

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889-qrtcz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-6d7f5d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-6d7f5d: serviceaccount "payload-processing-e2e-shared-a-w0-6d7f5d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-6d7f5d: serviceaccount "payload-processing-e2e-shared-a-w0-6d7f5d" not found

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-ckw8v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-7cg9w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf

SuccessfulCreate

Created pod: e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np
(x7)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

Unhealthy

Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

ProbeError

Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w4-6c54a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-6c54a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-6c54a1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-7cg9w

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-7cg9w

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-7cg9w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889-qrtcz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889-qrtcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889-qrtcz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889-qrtcz

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

Unhealthy

Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

ProbeError

Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw

Unhealthy

Startup probe failed: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw

ProbeError

Startup probe error: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-6c54a1: serviceaccount "payload-processing-e2e-shared-b-w4-6c54a1" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-ae5a1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-ae5a1c

openshift-ingress

deployment-controller

e2e-shared-b-w3-ae5a1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-2n9cv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-6c54a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc

SuccessfulCreate

Created pod: e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-6c54a1-67c898496c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-nt8g9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-6c54a1-67c898496c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-6c54a1: serviceaccount "payload-processing-e2e-shared-b-w4-6c54a1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-6c54a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-6c54a1-67c898496c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-nt8g9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-nt8g9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-2n9cv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-2n9cv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-nt8g9

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-2n9cv

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-2n9cv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-nt8g9

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-ae5a1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-ae5a1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-9zssq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-ae5a1c: serviceaccount "payload-processing-e2e-shared-b-w3-ae5a1c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-ae5a1c: serviceaccount "payload-processing-e2e-shared-b-w3-ae5a1c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-gj65l

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-gj65l

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-7a850e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-gj65l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-gj65l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-9zssq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-9zssq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-9zssq

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-gj65l

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-9zssq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-7a850e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 5 to 6

openshift-ingress

kubelet

e2e-praxis-b-dbff33-openshift-default-6d66d88fb5-6xr8z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2

Started

Container started

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-explicit-c8b702

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c8b702

openshift-ingress

deployment-controller

e2e-explicit-c8b702-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c8b702-openshift-default-58d85f4b45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-c8b702-openshift-default-58d85f4b45

SuccessfulCreate

Created pod: e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm

openshift-ingress

multus

e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm

AddedInterface

Add eth0 [10.133.0.228/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-46a67e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w4-46a67e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df

SuccessfulCreate

Created pod: e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

openshift-ingress

multus

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

AddedInterface

Add eth0 [10.133.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2

Unhealthy

Startup probe failed: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2

ProbeError

Startup probe error: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w0-e57add-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-e57add-openshift-default-b64556cbf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c8b702-85569ff95c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c8b702-85569ff95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c8b702: serviceaccount "payload-processing-e2e-explicit-c8b702" not found

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

Unhealthy

Readiness probe failed: Get "http://10.134.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

ProbeError

Readiness probe error: Get "http://10.134.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c8b702-85569ff95c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c8b702-85569ff95c-rvksj

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c8b702

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c8b702-85569ff95c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-e57add

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-e57add

openshift-ingress

replicaset-controller

e2e-shared-b-w0-e57add-openshift-default-b64556cbf

SuccessfulCreate

Created pod: e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c8b702

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c8b702-6874d9474c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c8b702-6874d9474c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c8b702-6874d9474c-rwvbx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c8b702-6874d9474c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c8b702-6874d9474c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c8b702: serviceaccount "payload-processing-e2e-explicit-c8b702" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c8b702-6874d9474c-rwvbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-c8b702-85569ff95c-rvksj

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c8b702-6874d9474c-rwvbx

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-c8b702-85569ff95c-rvksj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-c8b702-85569ff95c-rvksj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-c8b702-85569ff95c-rvksj

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c8b702-6874d9474c-rwvbx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c8b702-6874d9474c-rwvbx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

ProbeError

Startup probe error: Get "http://10.133.0.229:15021/healthz/ready": dial tcp 10.133.0.229:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

Unhealthy

Startup probe failed: Get "http://10.133.0.229:15021/healthz/ready": dial tcp 10.133.0.229:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-e57add

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-e57add: serviceaccount "payload-processing-e2e-shared-b-w0-e57add" not found

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulCreate

Created pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-e57add: serviceaccount "payload-processing-e2e-shared-b-w0-e57add" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-e57add

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

Created

Container created

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

AddedInterface

Add eth0 [10.133.0.230/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7-z8fwv

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc-nvmsq

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc-nvmsq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc-nvmsq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc-nvmsq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7-z8fwv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2e6bfd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2e6bfd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7-z8fwv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc-nvmsq

AddedInterface

Add eth0 [10.133.0.232/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7-z8fwv

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7-z8fwv

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

Unhealthy

Startup probe failed: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

Unhealthy

Startup probe failed: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

ProbeError

Startup probe error: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

ProbeError

Startup probe error: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

Unhealthy

Startup probe failed: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

ProbeError

Startup probe error: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

Unhealthy

Startup probe failed: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

ProbeError

Startup probe error: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk

ProbeError

Startup probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

Unhealthy

Startup probe failed: Get "http://10.133.0.230:15021/healthz/ready": dial tcp 10.133.0.230:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk

Unhealthy

Startup probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

ProbeError

Startup probe error: Get "http://10.133.0.230:15021/healthz/ready": dial tcp 10.133.0.230:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-46a67e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-46a67e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-e57add-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-e57add-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

ProbeError

Readiness probe error: Get "http://10.134.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

Unhealthy

Readiness probe failed: Get "http://10.134.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-7a850e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-7a850e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-ed4dce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-ed4dce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

ProbeError

Startup probe error: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

Unhealthy

Startup probe failed: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

Unhealthy

Startup probe failed: Get "http://10.133.0.226:15021/healthz/ready": dial tcp 10.133.0.226:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

ProbeError

Startup probe error: Get "http://10.133.0.226:15021/healthz/ready": dial tcp 10.133.0.226:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae5a1c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np

ProbeError

Startup probe error: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m

ProbeError

Startup probe error: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m

Unhealthy

Startup probe failed: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np

Unhealthy

Startup probe failed: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae5a1c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

ProbeError

Readiness probe error: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

Unhealthy

Readiness probe failed: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2e6bfd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-6c54a1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2e6bfd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-6c54a1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c8b702-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c8b702-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-46a67e-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df

SuccessfulCreate

Created pod: e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

openshift-ingress

deployment-controller

e2e-shared-a-w4-46a67e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df from 2 to 3

openshift-ingress

multus

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae5a1c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae5a1c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm

Unhealthy

Startup probe failed: Get "http://10.133.0.228:15021/healthz/ready": dial tcp 10.133.0.228:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm

ProbeError

Startup probe error: Get "http://10.133.0.228:15021/healthz/ready": dial tcp 10.133.0.228:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-c8b702-85569ff95c-rvksj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c8b702-6874d9474c-rwvbx

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-ed4dce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-ed4dce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-6c54a1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-6c54a1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c8b702-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-c8b702-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-6d7f5d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-6d7f5d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-e57add-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-e57add-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-explicit-c8b702-openshift-default-58d85f4b45-6mpdm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-ccfa21-openshift-default-865b6f9d69

SuccessfulCreate

Created pod: e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p

openshift-ingress

gateway_labeler_controller

e2e-noten-ccfa21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ccfa21

openshift-ingress

deployment-controller

e2e-noten-ccfa21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ccfa21-openshift-default-865b6f9d69 from 0 to 1

openshift-ingress

kubelet

e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p

Started

Container started

openshift-ingress

kubelet

e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p

Created

Container created

openshift-ingress

multus

e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-autores-f353c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-f353c2

openshift-ingress

deployment-controller

e2e-autores-f353c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-f353c2-openshift-default-65ff77f687 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-f353c2-openshift-default-65ff77f687

SuccessfulCreate

Created pod: e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq

openshift-ingress

multus

e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq

AddedInterface

Add eth0 [10.133.0.235/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-f353c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-f353c2-598dd8f8d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f353c2-598dd8f8d5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-f353c2-598dd8f8d5-vx9kw
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f353c2-598dd8f8d5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-f353c2-598dd8f8d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f353c2: serviceaccount "payload-processing-e2e-autores-f353c2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-f353c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-f353c2-57fcc4666c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f353c2-57fcc4666c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-f353c2-57fcc4666c-4jdp8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f353c2-57fcc4666c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-f353c2-57fcc4666c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f353c2: serviceaccount "payload-processing-e2e-autores-f353c2" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-f353c2-57fcc4666c-4jdp8

AddedInterface

Add eth0 [10.133.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f353c2-57fcc4666c-4jdp8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f353c2-57fcc4666c-4jdp8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f353c2-57fcc4666c-4jdp8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-f353c2-598dd8f8d5-vx9kw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-autores-f353c2-598dd8f8d5-vx9kw

AddedInterface

Add eth0 [10.133.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-f353c2-598dd8f8d5-vx9kw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-f353c2-598dd8f8d5-vx9kw

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-ccfa21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-ccfa21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-ccfa21-openshift-default-865b6f9d69-8tp2p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc

SuccessfulCreate

Created pod: e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

openshift-ingress

deployment-controller

e2e-shared-b-w3-ae5a1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae5a1c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

AddedInterface

Add eth0 [10.133.0.238/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

ProbeError

Startup probe error: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

Unhealthy

Startup probe failed: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq

Created

Container created

opendatahub

kubelet

test-curl-11422-009566

Created

Container created

opendatahub

kubelet

test-curl-11422-009566

Started

Container started

opendatahub

kubelet

test-curl-11422-009566

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11422-009566

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-f353c2-598dd8f8d5-vx9kw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f353c2-57fcc4666c-4jdp8

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-11422-009566

Killing

Stopping container test-curl-11422-009566

openshift-ingress

replicaset-controller

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5

SuccessfulCreate

Created pod: e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-5555cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-5555cb

openshift-ingress

deployment-controller

e2e-shared-a-w1-5555cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq

ProbeError

Startup probe error: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq

Unhealthy

Startup probe failed: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-f353c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-f353c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-5555cb-7f64c54897

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-5555cb-7f64c54897-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-5555cb: serviceaccount "payload-processing-e2e-shared-a-w1-5555cb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679-p4fzw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-5555cb: serviceaccount "payload-processing-e2e-shared-a-w1-5555cb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-5555cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-5555cb-7f64c54897 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-5555cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-5555cb-7f64c54897

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-5555cb-7f64c54897-vc7ct

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679-p4fzw

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-5555cb-7f64c54897-vc7ct

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-5555cb-7f64c54897-vc7ct

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679-p4fzw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679-p4fzw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679-p4fzw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-5555cb-7f64c54897-vc7ct

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-5555cb-7f64c54897-vc7ct

Started

Container started

openshift-ingress

kubelet

e2e-autores-f353c2-openshift-default-65ff77f687-2wmmq

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-11419-236a81

Created

Container created

opendatahub

kubelet

test-curl-11419-236a81

Started

Container started

opendatahub

kubelet

test-curl-11419-236a81

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11419-236a81

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11419-236a81

Killing

Stopping container test-curl-11419-236a81

opendatahub

multus

test-curl-11419-185384

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11419-185384

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11419-185384

Started

Container started

opendatahub

kubelet

test-curl-11419-185384

Created

Container created

opendatahub

kubelet

test-curl-11419-185384

Killing

Stopping container test-curl-11419-185384

opendatahub

kubelet

test-curl-11419-314a63

Created

Container created

opendatahub

kubelet

test-curl-11419-314a63

Started

Container started

opendatahub

multus

test-curl-11419-314a63

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11419-314a63

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11419-dc8377

Started

Container started

opendatahub

kubelet

test-curl-11419-dc8377

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11419-dc8377

Created

Container created

opendatahub

multus

test-curl-11419-dc8377

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11419-314a63

Killing

Stopping container test-curl-11419-314a63

opendatahub

kubelet

test-curl-11419-662c0f

Created

Container created

opendatahub

kubelet

test-curl-11419-662c0f

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11419-dc8377

Killing

Stopping container test-curl-11419-dc8377

opendatahub

kubelet

test-curl-11419-662c0f

Started

Container started

opendatahub

multus

test-curl-11419-662c0f

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-ac7e0d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69 from 0 to 1

opendatahub

kubelet

test-curl-11419-662c0f

Killing

Stopping container test-curl-11419-662c0f

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ac7e0d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ac7e0d

openshift-ingress

replicaset-controller

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69

SuccessfulCreate

Created pod: e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

openshift-ingress

multus

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

AddedInterface

Add eth0 [10.133.0.240/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ac7e0d: serviceaccount "payload-processing-e2e-extmod-a-ac7e0d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ac7e0d: serviceaccount "payload-processing-e2e-extmod-a-ac7e0d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-vskpv

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ac7e0d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-j7cvb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ac7e0d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-vskpv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-vskpv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-vskpv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-vskpv

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-j7cvb

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-j7cvb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-j7cvb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-j7cvb

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-89e955

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-89e955

openshift-ingress

replicaset-controller

e2e-shared-b-w1-89e955-openshift-default-6d68f7989

SuccessfulCreate

Created pod: e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

openshift-ingress

deployment-controller

e2e-shared-b-w1-89e955-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-89e955-openshift-default-6d68f7989 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-89e955-77fd5f8999

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-89e955-77fd5f8999-llbs6

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-89e955

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-89e955-77fd5f8999 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-89e955: serviceaccount "payload-processing-e2e-shared-b-w1-89e955" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9-nwtnn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-89e955

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-89e955-77fd5f8999

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-89e955-77fd5f8999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-89e955: serviceaccount "payload-processing-e2e-shared-b-w1-89e955" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-89e955-77fd5f8999-llbs6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9-nwtnn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-89e955-77fd5f8999-llbs6

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-89e955-77fd5f8999-llbs6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-89e955-77fd5f8999-llbs6

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9-nwtnn

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9-nwtnn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9-nwtnn

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

ProbeError

Readiness probe error: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

Unhealthy

Readiness probe failed: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-extmod-b-0b6abf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5

SuccessfulCreate

Created pod: e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0b6abf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0b6abf
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

Started

Container started

openshift-ingress

multus

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

AddedInterface

Add eth0 [10.133.0.242/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0b6abf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0b6abf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0b6abf-6bd8d86887 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0b6abf-6bd8d86887

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-lbttn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0b6abf-6bd8d86887

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0b6abf: serviceaccount "payload-processing-e2e-extmod-b-0b6abf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-99mp2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0b6abf: serviceaccount "payload-processing-e2e-extmod-b-0b6abf" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-lbttn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-lbttn

AddedInterface

Add eth0 [10.133.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-lbttn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-99mp2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-99mp2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-lbttn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-99mp2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-99mp2

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

ProbeError

Startup probe error: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

Unhealthy

Startup probe failed: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-20538a-openshift-default-55cc8fbd89

SuccessfulCreate

Created pod: e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-20538a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-20538a

openshift-ingress

deployment-controller

e2e-extmod-a-20538a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-20538a-openshift-default-55cc8fbd89 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-20538a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-20538a-854c797489 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-20538a-854c797489

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-20538a-854c797489-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-20538a: serviceaccount "payload-processing-e2e-extmod-a-20538a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-20538a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-20538a-66d844fc55 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-20538a-854c797489-sc8dk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-20538a-854c797489-sc8dk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-20538a-854c797489-sc8dk

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-20538a-66d844fc55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-nw6fl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-20538a-66d844fc55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-20538a: serviceaccount "payload-processing-e2e-extmod-a-20538a" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-20538a-854c797489-sc8dk

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-nw6fl

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-20538a-854c797489

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-20538a-854c797489-sc8dk

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-nw6fl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-nw6fl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-nw6fl

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-5555cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-5555cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

ProbeError

Readiness probe error: Get "http://10.133.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

Unhealthy

Readiness probe failed: Get "http://10.133.0.240:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-5555cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-5555cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

ProbeError

Startup probe error: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

Unhealthy

Startup probe failed: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

ProbeError

Startup probe error: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

Unhealthy

Startup probe failed: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-d0c6ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-d0c6ff

openshift-ingress

replicaset-controller

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9

SuccessfulCreate

Created pod: e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm

openshift-ingress

deployment-controller

e2e-extmod-b-d0c6ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d0c6ff-openshift-default-65866c4b9 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm

AddedInterface

Add eth0 [10.133.1.1/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d0c6ff: serviceaccount "payload-processing-e2e-extmod-b-d0c6ff" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2e6bfd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-xlc4c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-d0c6ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5

SuccessfulCreate

Created pod: e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-89e955-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-89e955-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d0c6ff-796996887

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-d0c6ff-796996887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d0c6ff: serviceaccount "payload-processing-e2e-extmod-b-d0c6ff" not found

openshift-ingress

deployment-controller

e2e-shared-b-w2-2e6bfd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5 from 1 to 2

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d0c6ff-796996887

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-d0c6ff-796996887-2lpxd

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-d0c6ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-d0c6ff-796996887 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-xlc4c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d0c6ff-796996887-2lpxd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d0c6ff-796996887-2lpxd

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-d0c6ff-796996887-2lpxd

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5

AddedInterface

Add eth0 [10.133.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-xlc4c

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-xlc4c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d0c6ff-796996887-2lpxd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-xlc4c

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-a-bb5c51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c from 0 to 1

openshift-ingress

kubelet

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

Unhealthy

Readiness probe failed: Get "http://10.134.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

ProbeError

Readiness probe error: Get "http://10.134.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-bb5c51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-bb5c51

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ac7e0d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ac7e0d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x8)

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5

Unhealthy

Startup probe failed: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5

ProbeError

Startup probe error: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-bb5c51-547cf58c9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-bb5c51-547cf58c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-bb5c51: serviceaccount "payload-processing-e2e-extmod-a-bb5c51" not found
(x2)

openshift-ingress

kubelet

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-bb5c51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-bb5c51-547cf58c9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-bb5c51-547cf58c9-m4fp5

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-bb5c51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-bb5c51-547cf58c9 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-q6nc6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-bb5c51: serviceaccount "payload-processing-e2e-extmod-a-bb5c51" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-q6nc6

AddedInterface

Add eth0 [10.133.1.5/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-bb5c51-547cf58c9-m4fp5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-bb5c51-547cf58c9-m4fp5

AddedInterface

Add eth0 [10.133.1.6/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-q6nc6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-bb5c51-547cf58c9-m4fp5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-q6nc6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-bb5c51-547cf58c9-m4fp5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-q6nc6

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-89e955-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-89e955-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-20538a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

Unhealthy

Startup probe failed: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-20538a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

ProbeError

Startup probe error: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-2186c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-2186c3

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulCreate

Created pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

openshift-ingress

deployment-controller

e2e-extmod-a-2186c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf from 0 to 1

openshift-ingress

multus

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-20538a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-20538a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-2186c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-2186c3-946d65949 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2186c3-946d65949

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-2186c3-946d65949-m2fh7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2186c3-946d65949

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-2186c3-946d65949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2186c3: serviceaccount "payload-processing-e2e-extmod-a-2186c3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-2186c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2186c3: serviceaccount "payload-processing-e2e-extmod-a-2186c3" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2186c3-946d65949-m2fh7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-extmod-a-2186c3-946d65949-m2fh7

AddedInterface

Add eth0 [10.133.1.8/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l

AddedInterface

Add eth0 [10.133.1.7/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2186c3-946d65949-m2fh7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2186c3-946d65949-m2fh7

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 10 to 9

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7hqq6

opendatahub

kubelet

test-curl-11428-a047dd

Created

Container created

opendatahub

kubelet

test-curl-11428-a047dd

Started

Container started

opendatahub

kubelet

test-curl-11428-a047dd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11428-a047dd

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11428-a047dd

Killing

Stopping container test-curl-11428-a047dd

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

openshift-ingress

deployment-controller

e2e-extmod-b-91b6b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-91b6b1-openshift-default-5ffb686549 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-91b6b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-91b6b1

openshift-ingress

multus

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-91b6b1-6865976887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-dfq2g
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-91b6b1-7c6b88ff

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-91b6b1: serviceaccount "payload-processing-e2e-extmod-b-91b6b1" not found

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 10 to 9

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulDelete

Deleted pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-91b6b1-6865976887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-91b6b1: serviceaccount "payload-processing-e2e-extmod-b-91b6b1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-91b6b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-91b6b1-6865976887 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-qv5lw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-91b6b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-91b6b1-7c6b88ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-91b6b1-7c6b88ff

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-2zjct

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-dfq2g

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-dfq2g

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-2zjct

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-dfq2g

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-2zjct

AddedInterface

Add eth0 [10.133.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-dfq2g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9

SuccessfulCreate

Created pod: e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-2zjct

Started

Container started

openshift-ingress

multus

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q

AddedInterface

Add eth0 [10.134.0.211/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-2zjct

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-b-d0c6ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d0c6ff-openshift-default-65866c4b9 from 1 to 3

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9

SuccessfulCreate

Created pod: e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d0c6ff-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dtwnw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulDelete

Deleted pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ft8wl

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 10 to 8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-77shl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-lnd5f
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

ProbeError

Startup probe error: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

Unhealthy

Startup probe failed: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q

ProbeError

Startup probe error: Get "http://10.134.0.211:15021/healthz/ready": dial tcp 10.134.0.211:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q

Unhealthy

Startup probe failed: Get "http://10.134.0.211:15021/healthz/ready": dial tcp 10.134.0.211:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x947t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-x947t
(x8)

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

Unhealthy

Startup probe failed: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

ProbeError

Startup probe error: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm

Unhealthy

Startup probe failed: Get "http://10.133.1.1:15021/healthz/ready": dial tcp 10.133.1.1:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm

ProbeError

Startup probe error: Get "http://10.133.1.1:15021/healthz/ready": dial tcp 10.133.1.1:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae5a1c-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w3-ae5a1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc from 2 to 3

openshift-ingress

replicaset-controller

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc

SuccessfulCreate

Created pod: e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

openshift-ingress

multus

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulDelete

Deleted pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-fb8jx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d0c6ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d0c6ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kcvjm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-v8lph

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 8 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

ProbeError

Startup probe error: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

Unhealthy

Startup probe failed: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cmp7l

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2186c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf

SuccessfulCreate

Created pod: e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b

openshift-ingress

deployment-controller

e2e-extmod-a-28e4f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2186c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-28e4f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-28e4f3

openshift-ingress

multus

e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b

AddedInterface

Add eth0 [10.133.1.12/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-df9d42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-df9d42-openshift-default-5df79d78fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-df9d42-openshift-default-5df79d78fc

SuccessfulCreate

Created pod: e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-df9d42

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-df9d42

openshift-ingress

multus

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

AddedInterface

Add eth0 [10.133.1.13/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-28e4f3: serviceaccount "payload-processing-e2e-extmod-a-28e4f3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-28e4f3-74bd497f6c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-28e4f3: serviceaccount "payload-processing-e2e-extmod-a-28e4f3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-28e4f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-28e4f3-74bd497f6c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-28e4f3-74bd497f6c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-r5p9h

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-c2x4s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-28e4f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-r5p9h

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-df9d42

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-r5p9h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-mcjfw

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-df9d42-675d896bc9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-df9d42-675d896bc9-5b9bh

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-df9d42

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-df9d42-675d896bc9 from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-df9d42: serviceaccount "payload-processing-e2e-extmod-b-df9d42" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-c2x4s

AddedInterface

Add eth0 [10.133.1.14/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-df9d42-675d896bc9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-df9d42-675d896bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-df9d42: serviceaccount "payload-processing-e2e-extmod-b-df9d42" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-c2x4s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-c2x4s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-r5p9h

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-r5p9h

AddedInterface

Add eth0 [10.133.1.15/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-c2x4s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-df9d42-675d896bc9-5b9bh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-mcjfw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-mcjfw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-mcjfw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-mcjfw

AddedInterface

Add eth0 [10.133.1.16/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0b6abf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0b6abf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-df9d42-675d896bc9-5b9bh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-df9d42-675d896bc9-5b9bh

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-df9d42-675d896bc9-5b9bh

AddedInterface

Add eth0 [10.133.1.17/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d0c6ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d0c6ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58

AddedInterface

Add eth0 [10.133.1.18/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-91b6b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-91b6b1-openshift-default-5ffb686549 from 1 to 4

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58

openshift-ingress

multus

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

AddedInterface

Add eth0 [10.133.1.19/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

openshift-ingress

deployment-controller

e2e-extmod-a-bb5c51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt

AddedInterface

Add eth0 [10.133.1.21/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

AddedInterface

Add eth0 [10.133.1.22/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

Unhealthy

Readiness probe failed: Get "http://10.134.0.206:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

ProbeError

Readiness probe error: Get "http://10.134.0.206:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

Unhealthy

Startup probe failed: Get "http://10.133.1.19:15021/healthz/ready": dial tcp 10.133.1.19:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58

Unhealthy

Startup probe failed: Get "http://10.133.1.18:15021/healthz/ready": dial tcp 10.133.1.18:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

ProbeError

Startup probe error: Get "http://10.133.1.19:15021/healthz/ready": dial tcp 10.133.1.19:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58

ProbeError

Startup probe error: Get "http://10.133.1.18:15021/healthz/ready": dial tcp 10.133.1.18:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-8dwl2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-bkb6q

Killing

Stopping container istio-proxy
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

ProbeError

Startup probe error: Get "http://10.133.1.22:15021/healthz/ready": dial tcp 10.133.1.22:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

Unhealthy

Startup probe failed: Get "http://10.133.1.22:15021/healthz/ready": dial tcp 10.133.1.22:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt

ProbeError

Startup probe error: Get "http://10.133.1.21:15021/healthz/ready": dial tcp 10.133.1.21:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt

Unhealthy

Startup probe failed: Get "http://10.133.1.21:15021/healthz/ready": dial tcp 10.133.1.21:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9

ProbeError

Startup probe error: Get "http://10.134.0.212:15021/healthz/ready": dial tcp 10.134.0.212:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-91b6b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-91b6b1-openshift-default-5ffb686549 from 4 to 8

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

openshift-ingress

multus

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

AddedInterface

Add eth0 [10.133.1.23/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj
(x6)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9

Unhealthy

Startup probe failed: Get "http://10.134.0.212:15021/healthz/ready": dial tcp 10.134.0.212:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

Started

Container started

openshift-ingress

multus

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9

Started

Container started

openshift-ingress

multus

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

AddedInterface

Add eth0 [10.133.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

Created

Container created

openshift-ingress

multus

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-bb5c51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c from 4 to 8

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

Started

Container started

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

Unhealthy

Readiness probe failed: Get "http://10.134.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

ProbeError

Readiness probe error: Get "http://10.134.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

AddedInterface

Add eth0 [10.133.1.25/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

ProbeError

Readiness probe error: Get "http://10.134.0.206:15021/healthz/ready": read tcp 10.134.0.2:34630->10.134.0.206:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

Unhealthy

Readiness probe failed: Get "http://10.134.0.206:15021/healthz/ready": read tcp 10.134.0.2:34630->10.134.0.206:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9

ProbeError

Startup probe error: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9

Unhealthy

Startup probe failed: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

ProbeError

Startup probe error: Get "http://10.133.1.23:15021/healthz/ready": dial tcp 10.133.1.23:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

Unhealthy

Startup probe failed: Get "http://10.133.1.23:15021/healthz/ready": dial tcp 10.133.1.23:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj

ProbeError

Startup probe error: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj

Unhealthy

Startup probe failed: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

ProbeError

Startup probe error: Get "http://10.133.1.24:15021/healthz/ready": dial tcp 10.133.1.24:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

Unhealthy

Startup probe failed: Get "http://10.133.1.24:15021/healthz/ready": dial tcp 10.133.1.24:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2186c3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulCreate

Created pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulCreate

Created pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulCreate

Created pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr

openshift-ingress

deployment-controller

e2e-extmod-a-2186c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf from 1 to 4
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

Unhealthy

Startup probe failed: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

ProbeError

Startup probe error: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

ProbeError

Startup probe error: Get "http://10.133.1.25:15021/healthz/ready": dial tcp 10.133.1.25:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

Unhealthy

Startup probe failed: Get "http://10.133.1.25:15021/healthz/ready": dial tcp 10.133.1.25:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq
(x9)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw

ProbeError

Startup probe error: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-c088fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-c088fd-openshift-default-7f9d69c989 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw

Unhealthy

Startup probe failed: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9

AddedInterface

Add eth0 [10.133.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9

Started

Container started

openshift-ingress

multus

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr

AddedInterface

Add eth0 [10.133.1.27/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-c088fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-c088fd

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

Created

Container created

openshift-ingress

multus

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98

AddedInterface

Add eth0 [10.134.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98

Created

Container created
(x3)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

ProbeError

Readiness probe error: Get "http://10.134.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98

Started

Container started
(x3)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

Unhealthy

Readiness probe failed: Get "http://10.134.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

AddedInterface

Add eth0 [10.134.0.220/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

Unhealthy

Startup probe failed: Get "http://10.134.0.206:15021/healthz/ready": dial tcp 10.134.0.206:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

ProbeError

Startup probe error: Get "http://10.134.0.206:15021/healthz/ready": dial tcp 10.134.0.206:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-gb6sg
(x8)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

Unhealthy

Startup probe failed: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-c088fd-856769599

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-c088fd-856769599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-c088fd: serviceaccount "payload-processing-e2e-extmod-b-c088fd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-c088fd-856769599

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-c088fd-856769599-cg7dc

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-c088fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-c088fd-856769599 from 0 to 1
(x8)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98

ProbeError

Startup probe error: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98

Unhealthy

Startup probe failed: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-c088fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-c088fd: serviceaccount "payload-processing-e2e-extmod-b-c088fd" not found
(x8)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

ProbeError

Startup probe error: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-gb6sg

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-c088fd-856769599-cg7dc

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-gb6sg

Started

Container started
(x13)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr

ProbeError

Startup probe error: Get "http://10.133.1.27:15021/healthz/ready": dial tcp 10.133.1.27:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-gb6sg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x13)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9

ProbeError

Startup probe error: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9

Unhealthy

Startup probe failed: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

ProbeError

Startup probe error: Get "http://10.134.0.207:15021/healthz/ready": dial tcp 10.134.0.207:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c088fd-856769599-cg7dc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c088fd-856769599-cg7dc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c088fd-856769599-cg7dc

Started

Container started
(x12)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr

Unhealthy

Startup probe failed: Get "http://10.133.1.27:15021/healthz/ready": dial tcp 10.133.1.27:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-gb6sg

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

Unhealthy

Startup probe failed: Get "http://10.134.0.207:15021/healthz/ready": dial tcp 10.134.0.207:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

multus

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm

openshift-ingress

deployment-controller

e2e-extmod-b-91b6b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-91b6b1-openshift-default-5ffb686549 from 8 to 9

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

ProbeError

Readiness probe error: Get "http://10.133.1.13:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

Unhealthy

Readiness probe failed: Get "http://10.133.1.13:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0b6abf-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

AddedInterface

Add eth0 [10.134.0.224/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5

SuccessfulCreate

Created pod: e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-b-0b6abf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm

ProbeError

Startup probe error: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm

Unhealthy

Startup probe failed: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2186c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

Unhealthy

Startup probe failed: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-28e4f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-28e4f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2186c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

ProbeError

Startup probe error: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b

ProbeError

Startup probe error: Get "http://10.133.1.12:15021/healthz/ready": dial tcp 10.133.1.12:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

ProbeError

Startup probe error: Get "http://10.133.1.13:15021/healthz/ready": dial tcp 10.133.1.13:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b

Unhealthy

Startup probe failed: Get "http://10.133.1.12:15021/healthz/ready": dial tcp 10.133.1.12:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

Unhealthy

Startup probe failed: Get "http://10.133.1.13:15021/healthz/ready": dial tcp 10.133.1.13:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulCreate

Created pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-wz8mb

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulCreate

Created pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-jd6ft

openshift-ingress

deployment-controller

e2e-extmod-a-2186c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf from 4 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2186c3-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulCreate

Created pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-f7fxd
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-df9d42-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-df9d42-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-28e4f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-28e4f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-df9d42-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-df9d42-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

Unhealthy

Readiness probe failed: Get "http://10.134.0.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

ProbeError

Readiness probe error: Get "http://10.134.0.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

openshift-ingress

deployment-controller

e2e-extmod-b-c088fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-c088fd-openshift-default-7f9d69c989 from 1 to 4

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-5tcws

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-92tjp

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c088fd-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

ProbeError

Startup probe error: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

Unhealthy

Startup probe failed: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

Started

Container started

openshift-ingress

multus

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

AddedInterface

Add eth0 [10.133.1.34/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c088fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c088fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

Unhealthy

Startup probe failed: Get "http://10.133.1.34:15021/healthz/ready": dial tcp 10.133.1.34:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

ProbeError

Startup probe error: Get "http://10.133.1.34:15021/healthz/ready": dial tcp 10.133.1.34:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-stvpm

openshift-ingress

deployment-controller

e2e-extmod-b-c088fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-c088fd-openshift-default-7f9d69c989 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c088fd-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-t4tcg

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-rhck7

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-zkssp

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-w2bml

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-dvzmv

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c088fd-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-c088fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-c088fd-openshift-default-7f9d69c989 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-bb5c51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c from 8 to 9

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-w2ptj

openshift-ingress

deployment-controller

e2e-extmod-b-df9d42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-df9d42-openshift-default-5df79d78fc from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-df9d42-openshift-default-5df79d78fc

SuccessfulCreate

Created pod: e2e-extmod-b-df9d42-openshift-default-5df79d78fc-fnpzz

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-df9d42-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-x47hr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c9ffffc7f-d8xb2
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-c9ffffc7f from 8 to 10

openshift-ingress

replicaset-controller

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df

SuccessfulCreate

Created pod: e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-snv26

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-46a67e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w4-46a67e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d0c6ff-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-d0c6ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d0c6ff-openshift-default-65866c4b9 from 3 to 4

openshift-ingress

replicaset-controller

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9

SuccessfulCreate

Created pod: e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

openshift-ingress

replicaset-controller

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f

SuccessfulCreate

Created pod: e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-kdn78

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 5

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gcjsr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-k8mmq

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9

SuccessfulCreate

Created pod: e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-9w4f9

openshift-ingress

deployment-controller

e2e-shared-a-w3-7a850e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-7a850e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

openshift-ingress

replicaset-controller

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc

SuccessfulCreate

Created pod: e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-jklmc

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-4jx7r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-vfrdd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-mbtr8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

AddedInterface

Add eth0 [10.134.0.233/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

ProbeError

Startup probe error: Get "http://10.134.0.233:15021/healthz/ready": dial tcp 10.134.0.233:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

Unhealthy

Startup probe failed: Get "http://10.134.0.233:15021/healthz/ready": dial tcp 10.134.0.233:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

AddedInterface

Add eth0 [10.133.1.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

ProbeError

Startup probe error: Get "http://10.133.1.55:15021/healthz/ready": dial tcp 10.133.1.55:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

Unhealthy

Startup probe failed: Get "http://10.133.1.55:15021/healthz/ready": dial tcp 10.133.1.55:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-c088fd-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulDelete

Deleted pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-stvpm

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulDelete

Deleted pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-dvzmv

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulDelete

Deleted pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-rhck7

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulDelete

Deleted pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-92tjp

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulDelete

Deleted pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-5tcws

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulDelete

Deleted pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-t4tcg

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulDelete

Deleted pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-zkssp

openshift-ingress

deployment-controller

e2e-extmod-b-c088fd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-c088fd-openshift-default-7f9d69c989 from 10 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-c088fd-openshift-default-7f9d69c989

SuccessfulDelete

Deleted pod: e2e-extmod-b-c088fd-openshift-default-7f9d69c989-w2bml

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulDelete

Deleted pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-lh8rk

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulDelete

Deleted pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-kdn78

openshift-ingress

deployment-controller

e2e-extmod-b-91b6b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-91b6b1-openshift-default-5ffb686549 from 9 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-46a67e-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae5a1c-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w4-46a67e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df from 4 to 3

openshift-ingress

replicaset-controller

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-snv26

openshift-ingress

replicaset-controller

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-jklmc

openshift-ingress

deployment-controller

e2e-shared-b-w3-ae5a1c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc from 3 to 2

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulDelete

Deleted pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-z285n

openshift-ingress

replicaset-controller

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9

SuccessfulDelete

Deleted pod: e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-9w4f9

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d0c6ff-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-d0c6ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-d0c6ff-openshift-default-65866c4b9 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-tpx85

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-2k7lk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulDelete

Deleted pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-jd6ft

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulDelete

Deleted pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-f7fxd

openshift-ingress

replicaset-controller

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf

SuccessfulDelete

Deleted pod: e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-wz8mb

openshift-ingress

deployment-controller

e2e-extmod-a-2186c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf from 7 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2186c3-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-df9d42-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-df9d42-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-df9d42-openshift-default-5df79d78fc from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-df9d42-openshift-default-5df79d78fc

SuccessfulDelete

Deleted pod: e2e-extmod-b-df9d42-openshift-default-5df79d78fc-fnpzz

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

Created

Container created

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

AddedInterface

Add eth0 [10.133.1.60/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

Unhealthy

Startup probe failed: Get "http://10.133.1.60:15021/healthz/ready": dial tcp 10.133.1.60:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

ProbeError

Startup probe error: Get "http://10.133.1.60:15021/healthz/ready": dial tcp 10.133.1.60:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

AddedInterface

Add eth0 [10.133.1.61/23] from ovn-kubernetes
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

ProbeError

Startup probe error: Get "http://10.133.1.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

Unhealthy

Startup probe failed: Get "http://10.133.1.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

ProbeError

Startup probe error: Get "http://10.133.1.61:15021/healthz/ready": dial tcp 10.133.1.61:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

Unhealthy

Startup probe failed: Get "http://10.133.1.61:15021/healthz/ready": dial tcp 10.133.1.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2186c3-946d65949-m2fh7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-e2e-extmod-a-2186c3-dockercfg-t4vjw); attempting to pull the image may not succeed.
(x4)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2186c3-675fbc4db7-f654l

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-plugins-e2e-extmod-a-2186c3" not found

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-vhnbr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-w7w98

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-cw4gg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-2186c3-openshift-default-7f4f7d8dbf-sz5h9

Killing

Stopping container istio-proxy
(x55)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-q4rgw

Unhealthy

Readiness probe failed: Get "https://10.133.0.30:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

AddedInterface

Add eth0 [10.134.0.241/23] from ovn-kubernetes
(x7)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

Started

Container started
(x8)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-df9d42-675d896bc9-5b9bh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-mcjfw

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

Unhealthy

Startup probe failed: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

ProbeError

Startup probe error: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-df9d42-openshift-default-5df79d78fc-l2dng

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-df9d42-5cff7d5d7-mcjfw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-df9d42-675d896bc9-5b9bh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-bnd5g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-rf4s6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulDelete

Deleted pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-nvtp9

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-bb5c51-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c from 9 to 7

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulDelete

Deleted pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-pr62m

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-vxzf8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-nxmn7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w4-46a67e-openshift-default-bdcdc75df-j22z9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-46a67e-776d585d75-rf4s6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-46a67e-59854dc8dc-bnd5g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulDelete

Deleted pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-ljvtj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-91b6b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-91b6b1-openshift-default-5ffb686549 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-nt8g9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-2n9cv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulDelete

Deleted pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-9j4dh

openshift-ingress

deployment-controller

e2e-extmod-a-bb5c51-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c from 7 to 6

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-2e6bfd-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w2-2e6bfd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

openshift-ingress

deployment-controller

e2e-extmod-b-91b6b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-91b6b1-openshift-default-5ffb686549 from 6 to 4

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulDelete

Deleted pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-zthqp

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-91b6b1-openshift-default-5ffb686549

SuccessfulDelete

Deleted pod: e2e-extmod-b-91b6b1-openshift-default-5ffb686549-xwm66

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-91b6b1-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-6xff8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulDelete

Deleted pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-ftq5m

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-bb5c51-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c from 6 to 5

openshift-ingress

kubelet

e2e-shared-b-w4-6c54a1-openshift-default-6944886cdf-rx2np

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w4-be6935-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-be6935-openshift-default-7bff7f4c57 from 7 to 5

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-be6935-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulDelete

Deleted pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

openshift-ingress

replicaset-controller

e2e-worker-w4-be6935-openshift-default-7bff7f4c57

SuccessfulDelete

Deleted pod: e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-ht4k9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-d0c6ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-d0c6ff-openshift-default-65866c4b9 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d0c6ff-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9

SuccessfulDelete

Deleted pod: e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-qbtsr

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-dbfsh

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-6c54a1-747c59c99f-2n9cv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-6c54a1-67c898496c-nt8g9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-0e8b5c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-0e8b5c-openshift-default-6786f5c45 from 6 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-0e8b5c-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulDelete

Deleted pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

openshift-ingress

replicaset-controller

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45

SuccessfulDelete

Deleted pod: e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-k8mmq

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k8mmq

Killing

Stopping container discovery

openshift-ingress

deployment-controller

e2e-shared-a-w3-7a850e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-7a850e-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-b488z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 5 to 4

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-9ldvd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7e5955-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-7e5955-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-7e5955-openshift-default-56b44f8bf5 from 6 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq
(x5)

openshift-ingress

deployment-controller

e2e-worker-w0-3cf6f4-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c from 6 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3cf6f4-openshift-default

SuccessfulRescale

(combined from similar events): New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-6fzbp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-cpc72

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-4kvhq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-4xs9m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-ch8d7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-9xmms

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-5vgt2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-9sdpw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-be6935-7cdc4bc59-wtf9p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-bb5c51-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c from 5 to 4

openshift-ingress

replicaset-controller

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c

SuccessfulDelete

Deleted pod: e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-rknbx

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-bb5c51-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-be6935-7cdc4bc59-wtf9p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-be6935-b7b86bd59-9sdpw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

endpoint-controller

payload-processing-e2e-extmod-a-ac7e0d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-extmod-a-ac7e0d: Operation cannot be fulfilled on endpoints "payload-processing-e2e-extmod-a-ac7e0d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-extmod-a-ac7e0d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c45177bc-1c91-45b8-923e-65aa9f22cc2c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-j7cvb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-vskpv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-x7tz2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-glmvr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-zj42d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-j782s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-be6935-openshift-default-7bff7f4c57-hlms7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ac7e0d-7b9cf656bc-j7cvb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ac7e0d-97dbbb8ff-vskpv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-ac7e0d-openshift-default-6b54b7bd69-lrrcl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-99mp2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-lbttn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-qklmr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-0b6abf-openshift-default-7764dc5fd5-z46fc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0b6abf-688d6d677f-99mp2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-7cg9w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6d7f5d-55dc497889-qrtcz

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0b6abf-6bd8d86887-lbttn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6d7f5d-6fcb6c95f5-7cg9w

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.166:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-6d7f5d-openshift-default-58d959544c-x4cvr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-e57add-7cb8c9f9bc-nvmsq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-e57add-7b6cb574d7-z8fwv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w0-e57add-openshift-default-b64556cbf-lmmcb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-vwfr6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-cd929

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3cf6f4-c46fdf49f-cd929

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3cf6f4-79f5765c79-vwfr6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-sfsnv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-gz4xd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-t5fjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3cf6f4-openshift-default-64cc779d9c-xwrd9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-nw6fl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-20538a-854c797489-sc8dk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-q6nc6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-bb5c51-547cf58c9-m4fp5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-20538a-openshift-default-55cc8fbd89-w5vww

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-20538a-854c797489-sc8dk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-20538a-66d844fc55-nw6fl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d0c6ff-796996887-2lpxd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-xlc4c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-kx5k9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-mwchw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-x4mpt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-bb5c51-7b67ddc79-q6nc6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-bb5c51-547cf58c9-m4fp5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-bb5c51-openshift-default-7bfc99cf7c-z8md7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-r5p9h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-c2x4s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-2zjct

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-dfq2g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-czj4q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d0c6ff-openshift-default-65866c4b9-m95mm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-28e4f3-openshift-default-5fd84fdcbf-mp22b

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d0c6ff-796996887-2lpxd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d0c6ff-b76b9fbb7-xlc4c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-25tr9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-gvtqm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-tgc58

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-91b6b1-openshift-default-5ffb686549-4bxbc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-5555cb-7f64c54897-vc7ct

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-5555cb-5495656679-p4fzw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c088fd-856769599-cg7dc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-gb6sg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-91b6b1-7c6b88ff-2zjct

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-28e4f3-9f95fd799-c2x4s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-91b6b1-6865976887-dfq2g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-28e4f3-74bd497f6c-r5p9h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-rbssh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-b4stk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

ProbeError

Readiness probe error: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w1-5555cb-openshift-default-54f4f8f5c5-4gj4m

Unhealthy

Readiness probe failed: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-9s9gq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-c088fd-openshift-default-7f9d69c989-j97vj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-89e955-77fd5f8999-llbs6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-89e955-58f65868c9-nwtnn

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-c088fd-856769599-cg7dc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-c088fd-68448dfd99-gb6sg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-ed4dce-openshift-default-7f55785c6f-9tt5m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-8w2q2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-mwxgr

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed4dce-6b7c7fc9b7-b4stk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed4dce-6f7544cb79-rbssh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-89e955-openshift-default-6d68f7989-kq5mn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2e6bfd-86bbf5f8c7-zj4nw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2e6bfd-789f97d447-w877l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-7a850e-openshift-default-848ffd8d8f-txcb5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-n7hhw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-rqzn7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7a850e-7947cfdfcf-8w2q2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-2e6bfd-openshift-default-5fd54bbdc5-9kkc5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7a850e-6d8b6bd575-mwxgr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-9zssq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-gj65l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-jlf9h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6ae519-5979494f57-gwzrt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-gwqhf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-ae5a1c-openshift-default-6dbf75d4bc-dvkb2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-0e8b5c-55758f85c9-n7hhw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-0e8b5c-5fdcffb6c5-rqzn7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-28flc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-75dms

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-qgldt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-r57ms

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-0e8b5c-openshift-default-6786f5c45-sc747

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae5a1c-6d84bc67d7-gj65l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae5a1c-9d8d8c57c-9zssq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6ae519-c9bf8d8cf-jlf9h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6ae519-5979494f57-gwzrt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-kf8f7

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

deployment-controller

e2e-worker-w2-6ae519-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-6ae519-openshift-default-54bbd75c8c from 4 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6ae519-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-7rq2h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-zzq7l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-6ae519-openshift-default-54bbd75c8c-k49d5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7e5955-54cd86c7cc-r57ms

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-qmjjh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-8d7k8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-58b8z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-7e5955-openshift-default-56b44f8bf5-llxpn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7e5955-7c6f68ff47-p5cwn

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.59:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-chwsm

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-chwsm

Killing

Stopping container discovery

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-d8xb2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-d8xb2
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-c9ffffc7f from 10 to 9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nbn54

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-nbn54

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-x47hr
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-c9ffffc7f from 9 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-x47hr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-8qmll

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-ks486

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-ks486

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-8qmll

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-c9ffffc7f from 8 to 6

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-c9ffffc7f from 6 to 4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-jpp7c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-xljzj

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-xljzj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p96n

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-5p96n

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-6dz48

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-c9ffffc7f from 4 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-v46nb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-v46nb

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-6dz48

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-c9ffffc7f from 2 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c9ffffc7f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c9ffffc7f-9vpv6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: