Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

Scheduled

Successfully assigned openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl to ip-10-0-131-28.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7 to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-284b60-5979976d4c-pnttj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-284b60-5979976d4c-pnttj to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3be042d3-7f5c57d965-gcfr5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3be042d3-7f5c57d965-gcfr5 to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9e8244-585f578586-xt4m5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9e8244-585f578586-xt4m5 to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-b2821608-d87bc8f74-zq2vt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-b2821608-d87bc8f74-zq2vt to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495-79nld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495-79nld to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-ait-74678972-openshift-default-95ff995b4-82mmc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-processing-e2e-derive-8a426531-5cd7b97465-7mrvb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-8a426531-5cd7b97465-7mrvb to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9-6fbdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9-6fbdk to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-2ed470-7774b96f4f-vld8l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2ed470-7774b96f4f-vld8l to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd-7qdrq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd-7qdrq to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5-tzksl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5-tzksl to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-ac8045-8595b767f-vbr46

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-ac8045-8595b767f-vbr46 to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2284bd-96c548dff-s5z6w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2284bd-96c548dff-s5z6w to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-autores-d94fd9-db66c95bf-5bxz4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-d94fd9-db66c95bf-5bxz4 to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-101425-5bcc58d697-626wc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-101425-5bcc58d697-626wc to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b to ip-10-0-131-28.ec2.internal

openshift-ingress

e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446-g6pdh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446-g6pdh to ip-10-0-130-207.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-ztvvb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztvvb to ip-10-0-133-251.ec2.internal

openshift-ingress

e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-6c7792-5555bc7fff-wkqhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-6c7792-5555bc7fff-wkqhk to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-401a67-69549bb69d-6z6f2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-401a67-69549bb69d-6z6f2 to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d6baf3-7644859c65-b7tkj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d6baf3-7644859c65-b7tkj to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-b2821608-85f7cb7574-6m6ss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-b2821608-85f7cb7574-6m6ss to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56 to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f-gj2sj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f-gj2sj to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-101425-8d55cd74-nz5s9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-101425-8d55cd74-nz5s9 to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-8a426531-c8668c79d-mcb5m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-8a426531-c8668c79d-mcb5m to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-mt-3be042d3-openshift-default-6495657988-9cj8n

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3be042d3-openshift-default-6495657988-9cj8n to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6-n9bjb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6-n9bjb to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2ed470-cdd98766-n4tlq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2ed470-cdd98766-n4tlq to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d-mzk95

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d-mzk95 to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-44f000-b7677b874-b2llk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-44f000-b7677b874-b2llk to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-fc8c65-567d4d5f45-rd49r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-fc8c65-567d4d5f45-rd49r to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a2455826-65d97d6f54-tn6nk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a2455826-65d97d6f54-tn6nk to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768 to ip-10-0-133-251.ec2.internal

openshift-ingress

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-74678972-68f87d4666-2ddrg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-74678972-68f87d4666-2ddrg to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546-8fbwj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546-8fbwj to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598-msj6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598-msj6n to ip-10-0-130-207.ec2.internal

openshift-ingress

router-default-5b79cff5dd-mnnh2

Scheduled

Successfully assigned openshift-ingress/router-default-5b79cff5dd-mnnh2 to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66-26tpv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66-26tpv to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8-qtklp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8-qtklp to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv to ip-10-0-133-251.ec2.internal

openshift-ingress

e2e-noten-dffccf-openshift-default-958f899b8-rzz7r

Scheduled

Successfully assigned openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r to ip-10-0-131-28.ec2.internal

openshift-ingress

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9 to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-pzqqj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-pzqqj to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

Scheduled

Successfully assigned openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b-nm29l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b-nm29l to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x to ip-10-0-131-28.ec2.internal

openshift-ingress

e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq to ip-10-0-131-28.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-df6776dd6-gkxhg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-df6776dd6-gkxhg to ip-10-0-133-251.ec2.internal

openshift-ingress

kube-auth-proxy-68bbd697f4-67sml

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-68bbd697f4-67sml to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a2455826-6c6c99ff7-brwh2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a2455826-6c6c99ff7-brwh2 to ip-10-0-130-207.ec2.internal

openshift-ingress

payload-processing-e2e-ait-74678972-68cb76cd55-t9bcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-74678972-68cb76cd55-t9bcb to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp to ip-10-0-131-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78-8ln2c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78-8ln2c to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v to ip-10-0-131-28.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-q5psz

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz to ip-10-0-131-28.ec2.internal

openshift-ingress

kube-auth-proxy-68bbd697f4-l4hhd

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-68bbd697f4-l4hhd to ip-10-0-130-207.ec2.internal

openshift-ingress

e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x to ip-10-0-133-251.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-x6j2c

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-x6j2c to ip-10-0-133-251.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5b79cff5dd from 0 to 1
(x16)

openshift-ingress

replicaset-controller

router-default-5b79cff5dd

FailedCreate

Error creating: pods "router-default-5b79cff5dd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5b79cff5dd

SuccessfulCreate

Created pod: router-default-5b79cff5dd-mnnh2
(x5)

openshift-ingress

kubelet

router-default-5b79cff5dd-mnnh2

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5b79cff5dd-mnnh2

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-5b79cff5dd-mnnh2

Created

Created container: router

openshift-ingress

kubelet

router-default-5b79cff5dd-mnnh2

Started

Started container router

openshift-ingress

multus

router-default-5b79cff5dd-mnnh2

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5b79cff5dd-mnnh2

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-68bbd697f4

SuccessfulCreate

Created pod: kube-auth-proxy-68bbd697f4-67sml

openshift-ingress

replicaset-controller

kube-auth-proxy-68bbd697f4

SuccessfulCreate

Created pod: kube-auth-proxy-68bbd697f4-l4hhd
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-68bbd697f4

FailedCreate

Error creating: pods "kube-auth-proxy-68bbd697f4-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-68bbd697f4 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-68bbd697f4-67sml

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-ztvvb

openshift-ingress

multus

kube-auth-proxy-68bbd697f4-67sml

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-68bbd697f4-l4hhd

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-68bbd697f4-l4hhd

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-ztvvb

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-68bbd697f4-67sml

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.878s (2.878s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ztvvb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-68bbd697f4-l4hhd

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-68bbd697f4-l4hhd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.846s (2.846s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-68bbd697f4-l4hhd

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-68bbd697f4-67sml

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-68bbd697f4-67sml

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ztvvb

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ztvvb

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ztvvb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.568s (2.568s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ztvvb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ztvvb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7b75d5c99c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7b75d5c99c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.614s (4.614s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7

Started

Started container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-q5psz

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-q5psz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-q5psz

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-q5psz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.205s (2.205s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-q5psz

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-q5psz

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ztvvb

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-ztvvb
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-df6776dd6

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-df6776dd6-gkxhg

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-df6776dd6 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-df6776dd6-gkxhg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-df6776dd6-gkxhg

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-df6776dd6-gkxhg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 9.391s (9.391s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-pzqqj

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pzqqj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-pzqqj

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-x6j2c
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-x6j2c

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x6j2c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pzqqj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.309s (2.309s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pzqqj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pzqqj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x6j2c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x6j2c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.129s (3.129s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x6j2c

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-df6776dd6-gkxhg

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-df6776dd6-gkxhg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-df6776dd6-gkxhg

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-df6776dd6-gkxhg

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-df6776dd6-gkxhg

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-401a67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-401a67

openshift-ingress

deployment-controller

e2e-worker-w0-7d96c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-fc8c65-openshift-default-54d59b494b

SuccessfulCreate

Created pod: e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

openshift-ingress

deployment-controller

e2e-worker-w4-fc8c65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-fc8c65-openshift-default-54d59b494b from 0 to 1

openshift-ingress

multus

e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-401a67-openshift-default-57fd984fb8

SuccessfulCreate

Created pod: e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-7d96c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-7d96c7

openshift-ingress

deployment-controller

e2e-inf-a-401a67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-401a67-openshift-default-57fd984fb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-fc8c65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-fc8c65

openshift-ingress

multus

e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8

SuccessfulCreate

Created pod: e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x

openshift-ingress

multus

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-fc8c65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-fc8c65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-fc8c65-567d4d5f45 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-fc8c65: serviceaccount "payload-processing-e2e-worker-w4-fc8c65" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-fc8c65-567d4d5f45

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-fc8c65-567d4d5f45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-fc8c65: serviceaccount "payload-processing-e2e-worker-w4-fc8c65" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78-8ln2c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78-8ln2c

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-401a67

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-401a67-69549bb69d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-401a67-69549bb69d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-401a67-69549bb69d-6z6f2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-401a67-69549bb69d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-401a67-69549bb69d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-401a67: serviceaccount "payload-processing-e2e-inf-a-401a67" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fc8c65-567d4d5f45-rd49r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fc8c65-567d4d5f45-rd49r

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-fc8c65-567d4d5f45-rd49r

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-fc8c65-567d4d5f45

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-fc8c65-567d4d5f45-rd49r

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-401a67

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-401a67-d88b56699 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78-8ln2c

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78-8ln2c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-401a67-d88b56699

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-401a67-d88b56699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-401a67: serviceaccount "payload-processing-e2e-inf-a-401a67" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fc8c65-567d4d5f45-rd49r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-401a67-d88b56699

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78-8ln2c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-7d96c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-401a67-69549bb69d-6z6f2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-401a67-69549bb69d-6z6f2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-401a67-69549bb69d-6z6f2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-7d96c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-401a67-69549bb69d-6z6f2

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b-nm29l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b-nm29l

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f-gj2sj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f-gj2sj

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f-gj2sj

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b-nm29l

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b-nm29l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f-gj2sj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f-gj2sj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7d96c7: serviceaccount "payload-processing-e2e-worker-w0-7d96c7" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7d96c7: serviceaccount "payload-processing-e2e-worker-w0-7d96c7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b-nm29l

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-a2455826-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a2455826-openshift-default-7bc749cc94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a2455826-openshift-default-7bc749cc94

SuccessfulCreate

Created pod: e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

openshift-ingress

kubelet

payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-autores-d94fd9-openshift-default-598ddfbcdb

SuccessfulCreate

Created pod: e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

openshift-ingress

deployment-controller

e2e-autores-d94fd9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-d94fd9-openshift-default-598ddfbcdb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.626s (1.627s including waiting). Image size: 166449312 bytes.

openshift-ingress

gateway_labeler_controller

e2e-autores-d94fd9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-d94fd9

openshift-ingress

kubelet

payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-a2455826

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a2455826

openshift-ingress

multus

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d94fd9: serviceaccount "payload-processing-e2e-autores-d94fd9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-d94fd9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d94fd9-db66c95bf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-d94fd9-db66c95bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-d94fd9: serviceaccount "payload-processing-e2e-autores-d94fd9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-d94fd9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-d94fd9-db66c95bf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a2455826

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a2455826-6c6c99ff7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-d94fd9-db66c95bf-5bxz4

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-d94fd9-db66c95bf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-d94fd9-db66c95bf-5bxz4

openshift-ingress

kubelet

payload-processing-e2e-autores-d94fd9-db66c95bf-5bxz4

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6-n9bjb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a2455826

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a2455826-65d97d6f54 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6-n9bjb

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6-n9bjb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6-n9bjb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6-n9bjb

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a2455826-6c6c99ff7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a2455826-6c6c99ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a2455826: serviceaccount "payload-processing-e2e-ait-a2455826" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-d94fd9-db66c95bf-5bxz4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-d94fd9-db66c95bf-5bxz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-a2455826-6c6c99ff7-brwh2

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a2455826-65d97d6f54-tn6nk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a2455826-65d97d6f54-tn6nk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a2455826-65d97d6f54-tn6nk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-a2455826-65d97d6f54-tn6nk

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a2455826-6c6c99ff7-brwh2

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:47018->10.134.0.37:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:47018->10.134.0.37:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-a2455826-6c6c99ff7-brwh2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-a2455826-6c6c99ff7-brwh2

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a2455826-65d97d6f54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a2455826-65d97d6f54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a2455826: serviceaccount "payload-processing-e2e-ait-a2455826" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a2455826-65d97d6f54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a2455826-65d97d6f54-tn6nk

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a2455826-6c6c99ff7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a2455826-6c6c99ff7-brwh2

openshift-ingress

multus

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-6c7792

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-6c7792
(x6)

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-6c7792-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-6c7792-openshift-default-858f4b58b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-6c7792-openshift-default-858f4b58b4

SuccessfulCreate

Created pod: e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9
(x2)

openshift-ingress

kubelet

e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-6c7792

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6c7792-5555bc7fff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-6c7792-5555bc7fff-wkqhk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6c7792-5555bc7fff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-6c7792-5555bc7fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6c7792: serviceaccount "payload-processing-e2e-inf-b-6c7792" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-6c7792

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-6c7792-5555bc7fff from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6c7792: serviceaccount "payload-processing-e2e-inf-b-6c7792" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd-7qdrq

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6c7792-5555bc7fff-wkqhk

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd-7qdrq

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6c7792-5555bc7fff-wkqhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd-7qdrq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd-7qdrq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-6c7792-5555bc7fff-wkqhk

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd-7qdrq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6c7792-5555bc7fff-wkqhk

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ait-a2455826-6c6c99ff7-brwh2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a2455826-65d97d6f54-tn6nk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-migrate-b2821608-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-b2821608-gw

openshift-ingress

deployment-controller

e2e-migrate-b2821608-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-b2821608-gw-openshift-default-64b969f5dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-b2821608-gw-openshift-default-64b969f5dd

SuccessfulCreate

Created pod: e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg

openshift-ingress

multus

e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b2821608-85f7cb7574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-b2821608-85f7cb7574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b2821608: serviceaccount "payload-processing-e2e-migrate-b2821608" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-b2821608

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-b2821608-d87bc8f74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b2821608-d87bc8f74

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-b2821608-d87bc8f74-zq2vt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b2821608-d87bc8f74

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-b2821608-d87bc8f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b2821608: serviceaccount "payload-processing-e2e-migrate-b2821608" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-b2821608

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-b2821608-85f7cb7574 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b2821608-85f7cb7574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-b2821608-85f7cb7574-6m6ss

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b2821608-85f7cb7574-6m6ss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-b2821608-d87bc8f74-zq2vt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-b2821608-85f7cb7574-6m6ss

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b2821608-85f7cb7574-6m6ss

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b2821608-85f7cb7574-6m6ss

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-b2821608-d87bc8f74-zq2vt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-b2821608-d87bc8f74-zq2vt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-b2821608-d87bc8f74-zq2vt

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b2821608-85f7cb7574-6m6ss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-b2821608-d87bc8f74-zq2vt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-74678972-openshift-default-95ff995b4-82mmc

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-74678972-openshift-default-95ff995b4

SuccessfulCreate

Created pod: e2e-ait-74678972-openshift-default-95ff995b4-82mmc

openshift-ingress

deployment-controller

e2e-ait-74678972-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-74678972-openshift-default-95ff995b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-74678972

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-74678972

openshift-ingress

kubelet

payload-processing-e2e-ait-74678972-68cb76cd55-t9bcb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-74678972-68f87d4666-2ddrg

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-74678972

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-74678972-68cb76cd55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-74678972-68cb76cd55

SuccessfulCreate

Created pod: payload-processing-e2e-ait-74678972-68cb76cd55-t9bcb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-74678972-68cb76cd55

FailedCreate

Error creating: pods "payload-processing-e2e-ait-74678972-68cb76cd55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-74678972: serviceaccount "payload-processing-e2e-ait-74678972" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-74678972-68f87d4666-2ddrg

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-74678972-68f87d4666-2ddrg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-74678972-68cb76cd55-t9bcb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-74678972-68f87d4666-2ddrg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-74678972-68cb76cd55-t9bcb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-74678972-68f87d4666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-74678972-68f87d4666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-74678972: serviceaccount "payload-processing-e2e-ait-74678972" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-74678972-68f87d4666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-74678972-68f87d4666-2ddrg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-74678972

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-74678972-68f87d4666 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-74678972-68cb76cd55-t9bcb

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-74678972-openshift-default-95ff995b4-82mmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-74678972-openshift-default-95ff995b4-82mmc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-74678972-openshift-default-95ff995b4-82mmc

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-74678972-openshift-default-95ff995b4-82mmc

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-74678972-openshift-default-95ff995b4-82mmc

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-74678972-68cb76cd55-t9bcb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-74678972-68f87d4666-2ddrg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-74678972-openshift-default-95ff995b4-82mmc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-8a426531

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-8a426531

openshift-ingress

deployment-controller

e2e-derive-8a426531-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-8a426531-openshift-default-547d959d88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-8a426531-openshift-default-547d959d88

SuccessfulCreate

Created pod: e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

openshift-ingress

multus

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8a426531-c8668c79d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-8a426531-c8668c79d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8a426531: serviceaccount "payload-processing-e2e-derive-8a426531" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8a426531-c8668c79d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-8a426531-c8668c79d-mcb5m

openshift-ingress

deployment-controller

payload-processing-e2e-derive-8a426531

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-8a426531-5cd7b97465 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8a426531-5cd7b97465

SuccessfulCreate

Created pod: payload-processing-e2e-derive-8a426531-5cd7b97465-7mrvb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8a426531-5cd7b97465

FailedCreate

Error creating: pods "payload-processing-e2e-derive-8a426531-5cd7b97465-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8a426531: serviceaccount "payload-processing-e2e-derive-8a426531" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-8a426531

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-8a426531-c8668c79d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-8a426531-5cd7b97465-7mrvb

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-8a426531-c8668c79d-mcb5m

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8a426531-c8668c79d-mcb5m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-8a426531-5cd7b97465-7mrvb

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-8a426531-5cd7b97465-7mrvb

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8a426531-c8668c79d-mcb5m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8a426531-c8668c79d-mcb5m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8a426531-5cd7b97465-7mrvb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-autores-d94fd9-db66c95bf-5bxz4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-d94fd9-dbc44ccd6-n9bjb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8a426531-5cd7b97465-7mrvb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8a426531-c8668c79d-mcb5m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-8a426531-openshift-default-547d959d88-ltdkl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-101425-openshift-default-569fcb69d8

SuccessfulCreate

Created pod: e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v

openshift-ingress

gateway_labeler_controller

e2e-explicit-101425

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-101425

openshift-ingress

deployment-controller

e2e-explicit-101425-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-101425-openshift-default-569fcb69d8 from 0 to 1

openshift-ingress

multus

e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-101425-8d55cd74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-101425-8d55cd74-nz5s9

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-101425-5bcc58d697

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-101425-5bcc58d697-626wc

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-101425

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-101425-5bcc58d697 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-101425-5bcc58d697

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-101425-5bcc58d697-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-101425: serviceaccount "payload-processing-e2e-explicit-101425" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-101425

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-101425-8d55cd74 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-101425-8d55cd74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-101425-8d55cd74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-101425: serviceaccount "payload-processing-e2e-explicit-101425" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-101425-8d55cd74-nz5s9

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-101425-5bcc58d697-626wc

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-101425-8d55cd74-nz5s9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-101425-8d55cd74-nz5s9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-101425-5bcc58d697-626wc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-101425-5bcc58d697-626wc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-101425-8d55cd74-nz5s9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-101425-5bcc58d697-626wc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-51b5e7aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-51b5e7aa

openshift-ingress

replicaset-controller

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8

SuccessfulCreate

Created pod: e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

openshift-ingress

deployment-controller

e2e-mt-51b5e7aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-51b5e7aa-openshift-default-5d9b586bb8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546-8fbwj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-51b5e7aa-5cccf55c8f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-51b5e7aa: serviceaccount "payload-processing-e2e-mt-51b5e7aa" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-51b5e7aa: serviceaccount "payload-processing-e2e-mt-51b5e7aa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-51b5e7aa-5cccf55c8f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj

openshift-ingress

deployment-controller

payload-processing-e2e-mt-51b5e7aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-51b5e7aa-5cccf55c8f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546-8fbwj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-51b5e7aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546-8fbwj

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546-8fbwj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546-8fbwj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51b5e7aa-6c5d86b546-8fbwj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-51b5e7aa

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-51b5e7aa: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-51b5e7aa": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-51b5e7aa, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cc175727-1f2a-4b0c-b2ef-5d8655118894, UID in object meta:

openshift-ingress

kubelet

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-processing-e2e-explicit-101425

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-explicit-101425: Operation cannot be fulfilled on endpoints "payload-processing-e2e-explicit-101425": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-explicit-101425, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 646a1b0a-9285-482b-a6e1-675c4f986318, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-101425-5bcc58d697-626wc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-101425-8d55cd74-nz5s9

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd

SuccessfulCreate

Created pod: e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x

openshift-ingress

deployment-controller

e2e-shared-a-w2-4fa336-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-4fa336

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-4fa336

openshift-ingress

multus

e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-4fa336

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4fa336: serviceaccount "payload-processing-e2e-shared-a-w2-4fa336" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-4fa336

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4fa336: serviceaccount "payload-processing-e2e-shared-a-w2-4fa336" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5-tzksl

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5-tzksl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5-tzksl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5-tzksl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5-tzksl

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-284b60-openshift-default-7dc65485d4

SuccessfulCreate

Created pod: e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x

openshift-ingress

deployment-controller

e2e-shared-b-w2-284b60-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-284b60-openshift-default-7dc65485d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-284b60

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-284b60

openshift-ingress

multus

e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66-26tpv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-284b60-5979976d4c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-284b60-5979976d4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-284b60: serviceaccount "payload-processing-e2e-shared-b-w2-284b60" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66-26tpv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66-26tpv

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66-26tpv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-284b60-5979976d4c-pnttj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-284b60-5979976d4c-pnttj

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-284b60: serviceaccount "payload-processing-e2e-shared-b-w2-284b60" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66-26tpv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-401a67-69549bb69d-6z6f2

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-284b60

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-284b60

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-284b60-5979976d4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-284b60-5979976d4c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-284b60-5979976d4c-pnttj

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-284b60-5979976d4c-pnttj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-284b60-5979976d4c-pnttj

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-noten-dffccf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-dffccf-openshift-default-958f899b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-dffccf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-dffccf

openshift-ingress

replicaset-controller

e2e-noten-dffccf-openshift-default-958f899b8

SuccessfulCreate

Created pod: e2e-noten-dffccf-openshift-default-958f899b8-rzz7r

openshift-ingress

kubelet

e2e-noten-dffccf-openshift-default-958f899b8-rzz7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-dffccf-openshift-default-958f899b8-rzz7r

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-dffccf-openshift-default-958f899b8-rzz7r

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-dffccf-openshift-default-958f899b8-rzz7r

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6c7792-5555bc7fff-wkqhk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6c7792-d4cb9b4fd-7qdrq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2284bd-openshift-default-648f79984d

SuccessfulCreate

Created pod: e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2284bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2284bd

openshift-ingress

deployment-controller

e2e-shared-a-w3-2284bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2284bd-openshift-default-648f79984d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-3be042d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3be042d3-openshift-default-6495657988 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2284bd: serviceaccount "payload-processing-e2e-shared-a-w3-2284bd" not found

openshift-ingress

replicaset-controller

e2e-mt-3be042d3-openshift-default-6495657988

SuccessfulCreate

Created pod: e2e-mt-3be042d3-openshift-default-6495657988-9cj8n

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2284bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2284bd-96c548dff from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-3be042d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3be042d3

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2284bd-96c548dff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2284bd-96c548dff-s5z6w
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2284bd-96c548dff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2284bd-96c548dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2284bd: serviceaccount "payload-processing-e2e-shared-a-w3-2284bd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598-msj6n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2284bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598 from 0 to 1

openshift-ingress

multus

e2e-mt-3be042d3-openshift-default-6495657988-9cj8n

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2284bd-96c548dff-s5z6w

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2284bd-96c548dff-s5z6w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2284bd-96c548dff-s5z6w

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598-msj6n

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2284bd-96c548dff-s5z6w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598-msj6n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598-msj6n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598-msj6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3be042d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3be042d3-7f5c57d965

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3be042d3-7f5c57d965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3be042d3: serviceaccount "payload-processing-e2e-mt-3be042d3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3be042d3: serviceaccount "payload-processing-e2e-mt-3be042d3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3be042d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3be042d3-7f5c57d965 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3be042d3-7f5c57d965

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3be042d3-7f5c57d965-gcfr5

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3be042d3-7f5c57d965-gcfr5

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-3be042d3-7f5c57d965-gcfr5

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-3be042d3-7f5c57d965-gcfr5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3be042d3-7f5c57d965-gcfr5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d

SuccessfulCreate

Created pod: e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-ac8045

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-ac8045

openshift-ingress

deployment-controller

e2e-shared-b-w3-ac8045-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-ac8045

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-ac8045-8595b767f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-ac8045-8595b767f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-ac8045-8595b767f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-ac8045: serviceaccount "payload-processing-e2e-shared-b-w3-ac8045" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-ac8045

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-ac8045: serviceaccount "payload-processing-e2e-shared-b-w3-ac8045" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8-qtklp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-ac8045-8595b767f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-ac8045-8595b767f-vbr46

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8-qtklp

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ac8045-8595b767f-vbr46

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-ac8045-8595b767f-vbr46

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8-qtklp

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ac8045-8595b767f-vbr46

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ac8045-8595b767f-vbr46

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8-qtklp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8-qtklp

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-3be042d3-openshift-default-6495657988-9cj8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": read tcp 10.134.0.2:60750->10.134.0.60:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": read tcp 10.134.0.2:60750->10.134.0.60:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3be042d3-openshift-default-6495657988-9cj8n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3be042d3-openshift-default-6495657988-9cj8n

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-3be042d3-openshift-default-6495657988-9cj8n

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-3be042d3-openshift-default-6495657988-9cj8n

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-dffccf-openshift-default-958f899b8-rzz7r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3be042d3-7f5c57d965-gcfr5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-3be042d3-openshift-default-6495657988-9cj8n

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-44f000

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-44f000

openshift-ingress

deployment-controller

e2e-api-a-44f000-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-44f000-openshift-default-644d7f58fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-44f000-openshift-default-644d7f58fb

SuccessfulCreate

Created pod: e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

openshift-ingress

multus

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-44f000

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-44f000-b7677b874 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-44f000-76cb4f666c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-44f000-76cb4f666c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-44f000: serviceaccount "payload-processing-e2e-api-a-44f000" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-44f000

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-44f000-76cb4f666c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-44f000-b7677b874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-44f000-b7677b874-b2llk

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-44f000-76cb4f666c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-44f000-b7677b874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-44f000-b7677b874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-44f000: serviceaccount "payload-processing-e2e-api-a-44f000" not found

openshift-ingress

multus

payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-44f000-b7677b874-b2llk

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-44f000-b7677b874-b2llk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-44f000-b7677b874-b2llk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-44f000-b7677b874-b2llk

Started

Started container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-7d96c7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-7d96c7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-7d96c7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-7d96c7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7da16a53-0acc-465e-bf5e-30b7ff75236e, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7d96c7-8bf8ccc9f-gj2sj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7d96c7-8585f964b-nm29l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-7d96c7-openshift-default-6bfd8ccbb8-6rp5x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-d6baf3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d6baf3-openshift-default-69fbd4974 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-d6baf3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d6baf3

openshift-ingress

replicaset-controller

e2e-api-b-d6baf3-openshift-default-69fbd4974

SuccessfulCreate

Created pod: e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

openshift-ingress

multus

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d-mzk95
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d6baf3: serviceaccount "payload-processing-e2e-api-b-d6baf3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d6baf3-7644859c65

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d6baf3-7644859c65-b7tkj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d6baf3-7644859c65

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d6baf3-7644859c65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d6baf3: serviceaccount "payload-processing-e2e-api-b-d6baf3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d6baf3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d6baf3-7644859c65 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-d6baf3-7644859c65-b7tkj

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6baf3-7644859c65-b7tkj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d6baf3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d-mzk95

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d-mzk95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6baf3-7644859c65-b7tkj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6baf3-7644859c65-b7tkj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d-mzk95

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d-mzk95

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

Unhealthy

Readiness probe failed: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

ProbeError

Readiness probe error: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-44f000-b7677b874-b2llk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-44f000-openshift-default-644d7f58fb-x2btg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6baf3-5bdf79c85d-mzk95

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6baf3-7644859c65-b7tkj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-d6baf3-openshift-default-69fbd4974-z6768

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4fa336-557b4df4f5-tzksl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fc8c65-567d4d5f45-rd49r

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-fc8c65

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-fc8c65: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-fc8c65": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-fc8c65, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 34690542-858c-4300-81a2-c5e5fb7fab47, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fc8c65-557cf9fd78-8ln2c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-284b60-5979976d4c-pnttj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-284b60-6dfb4bcc66-26tpv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-284b60-openshift-default-7dc65485d4-k684x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4

SuccessfulCreate

Created pod: e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

openshift-ingress

deployment-controller

e2e-ipp-a-2ed470-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-2ed470

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-2ed470

openshift-ingress

multus

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2ed470

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2ed470-7774b96f4f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2ed470-7774b96f4f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2ed470-7774b96f4f-vld8l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2ed470-7774b96f4f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2ed470-7774b96f4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2ed470: serviceaccount "payload-processing-e2e-ipp-a-2ed470" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2ed470

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2ed470-cdd98766 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2ed470-cdd98766

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2ed470-cdd98766-n4tlq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2ed470-cdd98766

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2ed470-cdd98766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2ed470: serviceaccount "payload-processing-e2e-ipp-a-2ed470" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-2ed470-7774b96f4f-vld8l

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2ed470-cdd98766-n4tlq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2ed470-cdd98766-n4tlq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2ed470-7774b96f4f-vld8l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2ed470-7774b96f4f-vld8l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2ed470-7774b96f4f-vld8l

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2ed470-cdd98766-n4tlq

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2ed470-cdd98766-n4tlq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

ProbeError

Readiness probe error: Get "http://10.133.0.91:15021/healthz/ready": read tcp 10.133.0.2:36340->10.133.0.91:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

Unhealthy

Readiness probe failed: Get "http://10.133.0.91:15021/healthz/ready": read tcp 10.133.0.2:36340->10.133.0.91:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-9e8244-openshift-default-7fbff77588

SuccessfulCreate

Created pod: e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-9e8244

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-9e8244

openshift-ingress

deployment-controller

e2e-ipp-b-9e8244-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-9e8244-openshift-default-7fbff77588 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9e8244: serviceaccount "payload-processing-e2e-ipp-b-9e8244" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9e8244

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9e8244

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9e8244-585f578586 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9e8244-585f578586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9e8244-585f578586-xt4m5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9e8244-585f578586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9e8244-585f578586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9e8244: serviceaccount "payload-processing-e2e-ipp-b-9e8244" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9-6fbdk

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9-6fbdk

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9-6fbdk

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9e8244-585f578586-xt4m5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9e8244-585f578586-xt4m5

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9e8244-585f578586-xt4m5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9e8244-585f578586-xt4m5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9-6fbdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9-6fbdk

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

Unhealthy

Readiness probe failed: Get "http://10.133.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

ProbeError

Readiness probe error: Get "http://10.133.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-11bfbd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-11bfbd

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

openshift-ingress

multus

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-11bfbd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-11bfbd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-11bfbd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-11bfbd: serviceaccount "payload-processing-e2e-ipp-cleanup-11bfbd" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-11bfbd: serviceaccount "payload-processing-e2e-ipp-cleanup-11bfbd" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446-g6pdh

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446-g6pdh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446-g6pdh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446-g6pdh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495-79nld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446-g6pdh

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495-79nld

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495-79nld

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495-79nld

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495-79nld

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-11bfbd-c9bf66495-79nld

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-11bfbd-769648f446-g6pdh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-11bfbd-openshift-default-679bb8df6d-mrncm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2ed470-7774b96f4f-vld8l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2ed470-cdd98766-n4tlq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-2ed470-openshift-default-6b56ccc9c4-c85vz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9e8244-7f7ddb46c9-6fbdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9e8244-585f578586-xt4m5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-9e8244-openshift-default-7fbff77588-7g4sx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2284bd-96c548dff-s5z6w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2284bd-6f88457598-msj6n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ac8045-6b476b45f8-qtklp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ac8045-8595b767f-vbr46

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-ac8045-openshift-default-6f69dd7d6d-nf9gv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: