Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp to ip-10-0-133-55.ec2.internal

openshift-ingress

e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd to ip-10-0-135-118.ec2.internal

openshift-ingress

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq to ip-10-0-135-118.ec2.internal

openshift-ingress

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv to ip-10-0-135-118.ec2.internal

openshift-ingress

e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph to ip-10-0-135-118.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-w62gl

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-w62gl to ip-10-0-135-118.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-hbdtq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq to ip-10-0-137-198.ec2.internal

openshift-ingress

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s to ip-10-0-135-118.ec2.internal

openshift-ingress

kube-auth-proxy-59c4b4bfcf-6rm4r

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r to ip-10-0-137-198.ec2.internal

openshift-ingress

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2 to ip-10-0-135-118.ec2.internal

openshift-ingress

kube-auth-proxy-59c4b4bfcf-qsdmz

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz to ip-10-0-133-55.ec2.internal

openshift-ingress

e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4 to ip-10-0-135-118.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr to ip-10-0-137-198.ec2.internal

openshift-ingress

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4 to ip-10-0-137-198.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-8xmlm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm to ip-10-0-137-198.ec2.internal

openshift-ingress

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg to ip-10-0-137-198.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh to ip-10-0-133-55.ec2.internal

openshift-ingress

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx to ip-10-0-135-118.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cfq4n8

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfq4n8 to ip-10-0-135-118.ec2.internal

openshift-ingress

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b to ip-10-0-135-118.ec2.internal

openshift-ingress

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2 to ip-10-0-137-198.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666 to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29 to ip-10-0-133-55.ec2.internal

openshift-ingress

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr to ip-10-0-135-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45 to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz to ip-10-0-133-55.ec2.internal

openshift-ingress

router-default-5d4699ff7f-xg2hr

Scheduled

Successfully assigned openshift-ingress/router-default-5d4699ff7f-xg2hr to ip-10-0-137-198.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h to ip-10-0-133-55.ec2.internal

openshift-ingress

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6 to ip-10-0-137-198.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5 to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2 to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5 to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62 to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9 to ip-10-0-137-198.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8 to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld to ip-10-0-133-55.ec2.internal

openshift-ingress

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w to ip-10-0-135-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n to ip-10-0-133-55.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-6txxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-6txxf to ip-10-0-133-55.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5d4699ff7f from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-5d4699ff7f

FailedCreate

Error creating: pods "router-default-5d4699ff7f-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-5d4699ff7f

FailedCreate

Error creating: pods "router-default-5d4699ff7f-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5d4699ff7f

SuccessfulCreate

Created pod: router-default-5d4699ff7f-xg2hr
(x5)

openshift-ingress

kubelet

router-default-5d4699ff7f-xg2hr

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5d4699ff7f-xg2hr

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-5d4699ff7f-xg2hr

AddedInterface

Add eth0 [10.134.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5d4699ff7f-xg2hr

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-5d4699ff7f-xg2hr

Created

Created container: router

openshift-ingress

kubelet

router-default-5d4699ff7f-xg2hr

Started

Started container router

openshift-ingress

kubelet

kube-auth-proxy-59c4b4bfcf-6rm4r

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-59c4b4bfcf

FailedCreate

Error creating: pods "kube-auth-proxy-59c4b4bfcf-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-59c4b4bfcf-6rm4r

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-59c4b4bfcf

SuccessfulCreate

Created pod: kube-auth-proxy-59c4b4bfcf-6rm4r

openshift-ingress

kubelet

kube-auth-proxy-59c4b4bfcf-qsdmz

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-59c4b4bfcf-qsdmz

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-59c4b4bfcf

SuccessfulCreate

Created pod: kube-auth-proxy-59c4b4bfcf-qsdmz

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-59c4b4bfcf from 0 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-hbdtq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-hbdtq

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hbdtq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-59c4b4bfcf-qsdmz

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59c4b4bfcf-qsdmz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.806s (2.806s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59c4b4bfcf-qsdmz

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hbdtq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.583s (4.583s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59c4b4bfcf-6rm4r

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59c4b4bfcf-6rm4r

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59c4b4bfcf-6rm4r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.997s (5.997s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hbdtq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hbdtq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hbdtq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hbdtq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cfq4n8

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-w62gl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-w62gl

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cfq4n8

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-w62gl

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfq4n8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-w62gl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.801s (3.801s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfq4n8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.992s (3.992s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfq4n8

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-w62gl

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-w62gl

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfq4n8

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-hbdtq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hbdtq

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-sjrkr

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.924s (2.924s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

multus

payload-processing-5cc6cd444b-6txxf

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-8xmlm

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-8xmlm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-6txxf

openshift-ingress

kubelet

payload-processing-5cc6cd444b-6txxf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-8xmlm

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-8xmlm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-8xmlm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-6txxf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.727s (1.727s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-6txxf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-6txxf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-8xmlm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.982s (1.982s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-sjrkr

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-9092d698

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9092d698

openshift-ingress

multus

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-9092d698-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9092d698-openshift-default-7df756b78b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-9092d698-openshift-default-7df756b78b

SuccessfulCreate

Created pod: e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9092d698-6bb7b994bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9092d698: serviceaccount "payload-processing-e2e-ait-9092d698" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9092d698-55bb5774b6

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9092d698-55bb5774b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9092d698: serviceaccount "payload-processing-e2e-ait-9092d698" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9092d698

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9092d698-55bb5774b6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9092d698

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9092d698-6bb7b994bd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9092d698-55bb5774b6

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9092d698-6bb7b994bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

Unhealthy

Readiness probe failed: Get "http://10.133.0.23:15021/healthz/ready": read tcp 10.133.0.2:52876->10.133.0.23:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

ProbeError

Readiness probe error: Get "http://10.133.0.23:15021/healthz/ready": read tcp 10.133.0.2:52876->10.133.0.23:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

ProbeError

Startup probe error: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

Unhealthy

Startup probe failed: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-e5dec626-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e5dec626-gw

openshift-ingress

deployment-controller

e2e-migrate-e5dec626-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e5dec626-gw-openshift-default-f9794b548 from 0 to 1

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-e5dec626-gw-openshift-default-f9794b548

SuccessfulCreate

Created pod: e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e5dec626-d94bfb8d9

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e5dec626

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e5dec626-d94bfb8d9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e5dec626

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e5dec626-d94bfb8d9

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e5dec626-d94bfb8d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e5dec626: serviceaccount "payload-processing-e2e-migrate-e5dec626" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e5dec626: serviceaccount "payload-processing-e2e-migrate-e5dec626" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-9092d698-openshift-default-7df756b78b-kxr9b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

ProbeError

Readiness probe error: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

Unhealthy

Readiness probe failed: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

ProbeError

Startup probe error: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

Unhealthy

Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-cd573186-openshift-default-7cdd4b84bb

SuccessfulCreate

Created pod: e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

openshift-ingress

deployment-controller

e2e-ait-cd573186-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-cd573186-openshift-default-7cdd4b84bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-cd573186

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-cd573186

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-e5dec626-gw-openshift-default-f9794b548-n5dc2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-cd573186-69d8cd79d6

SuccessfulCreate

Created pod: payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld

openshift-ingress

deployment-controller

payload-processing-e2e-ait-cd573186

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-cd573186-69d8cd79d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-cd573186-69d8cd79d6

FailedCreate

Error creating: pods "payload-processing-e2e-ait-cd573186-69d8cd79d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-cd573186: serviceaccount "payload-processing-e2e-ait-cd573186" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-cd573186

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-cd573186-69788d9648 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-cd573186-69788d9648

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-cd573186-69788d9648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-cd573186: serviceaccount "payload-processing-e2e-ait-cd573186" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-cd573186-69788d9648

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp

openshift-ingress

kubelet

payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-2de2fd7b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2de2fd7b-openshift-default-6cdbb766b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-2de2fd7b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2de2fd7b

openshift-ingress

replicaset-controller

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8

SuccessfulCreate

Created pod: e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

openshift-ingress

multus

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2de2fd7b: serviceaccount "payload-processing-e2e-derive-2de2fd7b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2de2fd7b-568fdfc8c8

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2de2fd7b: serviceaccount "payload-processing-e2e-derive-2de2fd7b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2de2fd7b-568fdfc8c8

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2de2fd7b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2de2fd7b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2de2fd7b-568fdfc8c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

Unhealthy

Startup probe failed: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

ProbeError

Startup probe error: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-2de2fd7b-openshift-default-6cdbb766b8-zskcr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-8c9d47c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8c9d47c1

openshift-ingress

GatewayAuthBootstrap

e2e-mt-8c9d47c1

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-8c9d47c1-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-8c9d47c1-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-mt-8c9d47c1-openshift-default-69769c468d

SuccessfulCreate

Created pod: e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

openshift-ingress

multus

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-8c9d47c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8c9d47c1-openshift-default-69769c468d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8c9d47c1-5758bf646b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8c9d47c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8c9d47c1-5758bf646b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8c9d47c1: serviceaccount "payload-processing-e2e-mt-8c9d47c1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8c9d47c1-5758bf646b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8c9d47c1-5758bf646b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8c9d47c1: serviceaccount "payload-processing-e2e-mt-8c9d47c1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8c9d47c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

Unhealthy

Readiness probe failed: Get "http://10.133.0.28:15021/healthz/ready": read tcp 10.133.0.2:36360->10.133.0.28:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

ProbeError

Readiness probe error: Get "http://10.133.0.28:15021/healthz/ready": read tcp 10.133.0.2:36360->10.133.0.28:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-8c9d47c1-openshift-default-69769c468d-z8b9s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-mt-99c2ecca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-99c2ecca

openshift-ingress

replicaset-controller

e2e-mt-99c2ecca-openshift-default-56c5947d44

SuccessfulCreate

Created pod: e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

openshift-ingress

multus

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-mt-99c2ecca

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-99c2ecca-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-99c2ecca-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-mt-99c2ecca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-99c2ecca-openshift-default-56c5947d44 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-99c2ecca-67855c4f78

FailedCreate

Error creating: pods "payload-processing-e2e-mt-99c2ecca-67855c4f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-99c2ecca: serviceaccount "payload-processing-e2e-mt-99c2ecca" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-99c2ecca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-99c2ecca-67855c4f78 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-99c2ecca-659c669fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-99c2ecca-659c669fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-99c2ecca: serviceaccount "payload-processing-e2e-mt-99c2ecca" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-99c2ecca-659c669fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-99c2ecca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-99c2ecca-659c669fb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-99c2ecca-67855c4f78

SuccessfulCreate

Created pod: payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm
(x2)

openshift-ingress

kubelet

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-99c2ecca-openshift-default-56c5947d44-jwpqq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-inf-a-d11ca7-openshift-default-7d96f7cb68

SuccessfulCreate

Created pod: e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd

openshift-ingress

deployment-controller

e2e-inf-a-d11ca7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d11ca7-openshift-default-7d96f7cb68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d11ca7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d11ca7

openshift-ingress

multus

e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d11ca7-754bd64756

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d11ca7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d11ca7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d11ca7-754bd64756 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d11ca7-754bd64756

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d11ca7-754bd64756-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d11ca7: serviceaccount "payload-processing-e2e-inf-a-d11ca7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d11ca7: serviceaccount "payload-processing-e2e-inf-a-d11ca7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-5f678c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5f678c-openshift-default-78b4b8849d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-5f678c-openshift-default-78b4b8849d

SuccessfulCreate

Created pod: e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5f678c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5f678c

openshift-ingress

multus

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5f678c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5f678c-79b675885b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5f678c: serviceaccount "payload-processing-e2e-inf-b-5f678c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5f678c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5f678c-79b675885b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5f678c-79b675885b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5f678c: serviceaccount "payload-processing-e2e-inf-b-5f678c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5f678c-79b675885b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": read tcp 10.133.0.2:39786->10.133.0.33:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": read tcp 10.133.0.2:39786->10.133.0.33:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-d11ca7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-d11ca7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f6f4453c-e6ba-4395-a4c4-2ef3154a3ffa, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-d11ca7-openshift-default-7d96f7cb68-qtztd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4

SuccessfulCreate

Created pod: e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

openshift-ingress

kubelet

e2e-inf-b-5f678c-openshift-default-78b4b8849d-4lvmx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-dc78bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-dc78bf

openshift-ingress

deployment-controller

e2e-api-a-dc78bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4 from 0 to 1

openshift-ingress

multus

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-dc78bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-dc78bf-78878865dd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dc78bf: serviceaccount "payload-processing-e2e-api-a-dc78bf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-dc78bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dc78bf-78878865dd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-dc78bf-78878865dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dc78bf: serviceaccount "payload-processing-e2e-api-a-dc78bf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dc78bf-78878865dd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666

Unhealthy

Readiness probe failed: dial tcp 10.132.0.60:9004: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d

SuccessfulCreate

Created pod: e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

openshift-ingress

multus

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-fb2e9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-fb2e9f-openshift-default-5446ff7c5d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-fb2e9f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-fb2e9f

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-fb2e9f: serviceaccount "payload-processing-e2e-api-b-fb2e9f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-fb2e9f-668c67d7fd

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-fb2e9f-668c67d7fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-fb2e9f: serviceaccount "payload-processing-e2e-api-b-fb2e9f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-fb2e9f-668c67d7fd

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-fb2e9f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-fb2e9f-668c67d7fd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-fb2e9f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

ProbeError

Readiness probe error: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

Unhealthy

Readiness probe failed: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-fb2e9f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-fb2e9f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d38f9958-a541-48ea-b07f-4a8d03a3096a, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-fb2e9f-openshift-default-5446ff7c5d-k477w

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-4ef902

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-4ef902

openshift-ingress

replicaset-controller

e2e-shared-a-4ef902-openshift-default-6dcd5d969b

SuccessfulCreate

Created pod: e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

openshift-ingress

multus

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-4ef902-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-4ef902-openshift-default-6dcd5d969b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-4ef902-7d6ff4cc78

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-4ef902

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-4ef902-7d6ff4cc78

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-4ef902: serviceaccount "payload-processing-e2e-shared-a-4ef902" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-4ef902: serviceaccount "payload-processing-e2e-shared-a-4ef902" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-4ef902

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-4ef902-7d6ff4cc78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr

openshift-ingress

kubelet

payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-0b2dae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-0b2dae-openshift-default-96d588c44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-0b2dae-openshift-default-96d588c44

SuccessfulCreate

Created pod: e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph

openshift-ingress

gateway_labeler_controller

e2e-shared-b-0b2dae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-0b2dae

openshift-ingress

multus

e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-0b2dae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-0b2dae: serviceaccount "payload-processing-e2e-shared-b-0b2dae" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-0b2dae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-0b2dae: serviceaccount "payload-processing-e2e-shared-b-0b2dae" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n

openshift-ingress

multus

payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7fa598

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7fa598

openshift-ingress

deployment-controller

e2e-ipp-a-7fa598-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7fa598-openshift-default-6d897d5658 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-7fa598-openshift-default-6d897d5658

SuccessfulCreate

Created pod: e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

openshift-ingress

multus

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7fa598

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7fa598-685fd85574 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7fa598: serviceaccount "payload-processing-e2e-ipp-a-7fa598" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7fa598

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7fa598-685fd85574

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7fa598-685fd85574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7fa598: serviceaccount "payload-processing-e2e-ipp-a-7fa598" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7fa598-685fd85574

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

ProbeError

Readiness probe error: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

Unhealthy

Readiness probe failed: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-edaa93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-edaa93

openshift-ingress

deployment-controller

e2e-ipp-b-edaa93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d from 0 to 1

openshift-ingress

multus

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d

SuccessfulCreate

Created pod: e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-edaa93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-edaa93-99c599b66 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-edaa93-99c599b66

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-edaa93-99c599b66

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-edaa93-99c599b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-edaa93: serviceaccount "payload-processing-e2e-ipp-b-edaa93" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-edaa93: serviceaccount "payload-processing-e2e-ipp-b-edaa93" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-edaa93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

ProbeError

Readiness probe error: Get "http://10.134.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

Unhealthy

Readiness probe failed: Get "http://10.134.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-859003-openshift-default-7d9b744d98

SuccessfulCreate

Created pod: e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4

openshift-ingress

deployment-controller

e2e-ipp-cleanup-859003-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-859003-openshift-default-7d9b744d98 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-859003

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-859003

openshift-ingress

multus

e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-859003: serviceaccount "payload-processing-e2e-ipp-cleanup-859003" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-859003: serviceaccount "payload-processing-e2e-ipp-cleanup-859003" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-859003

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-859003

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-859003-openshift-default-7d9b744d98-dzsg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-4ef902-openshift-default-6dcd5d969b-nfwrv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-0b2dae-openshift-default-96d588c44-vn8ph

Killing

Stopping container istio-proxy