Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-migrate-a6605e44-5655bc988d-b7g4m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a6605e44-5655bc988d-b7g4m to ip-10-0-141-85.ec2.internal

openshift-ingress

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644-xmgpj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644-xmgpj to ip-10-0-141-85.ec2.internal

openshift-ingress

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g to ip-10-0-134-28.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-sfjl8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-sfjl8 to ip-10-0-141-85.ec2.internal

openshift-ingress

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b-zpffv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b-zpffv to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-5ca190-846b74dbfb-tqj9p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-5ca190-846b74dbfb-tqj9p to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b11aa3-84998f9b56-v9zr5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b11aa3-84998f9b56-v9zr5 to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-14be608d-c6599f464-bm74k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-14be608d-c6599f464-bm74k to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6ce027-78bffbb456-vpkhc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-6ce027-78bffbb456-vpkhc to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b-sw2nm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b-sw2nm to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556-p64vz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556-p64vz to ip-10-0-141-85.ec2.internal

openshift-ingress

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26 to ip-10-0-134-28.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-lpl76

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpl76 to ip-10-0-136-247.ec2.internal

openshift-ingress

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn to ip-10-0-134-28.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-jffhc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jffhc to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44-k252t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44-k252t to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-671ba06b-74776589d8-zgn7s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-671ba06b-74776589d8-zgn7s to ip-10-0-141-85.ec2.internal

openshift-ingress

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-55b321-c7fb48d76-qgdgk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-55b321-c7fb48d76-qgdgk to ip-10-0-141-85.ec2.internal

openshift-ingress

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4-6l6fp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4-6l6fp to ip-10-0-141-85.ec2.internal

openshift-ingress

kube-auth-proxy-95755dfb5-nf8t8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-95755dfb5-nf8t8 to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-fba93c-5c946cf868-lppnd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-fba93c-5c946cf868-lppnd to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-5692l

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-5692l to ip-10-0-141-85.ec2.internal

openshift-ingress

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-processing-e2e-ait-095ac0a0-867854c55d-2x5df

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-095ac0a0-867854c55d-2x5df to ip-10-0-141-85.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-g2m8j

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-g2m8j to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-processing-e2e-ait-76aaf06c-bb948fdb8-lcws9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-76aaf06c-bb948fdb8-lcws9 to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-kk9td

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-kk9td to ip-10-0-136-247.ec2.internal

openshift-ingress

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl to ip-10-0-134-28.ec2.internal

openshift-ingress

kube-auth-proxy-95755dfb5-kmw2m

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-95755dfb5-kmw2m to ip-10-0-134-28.ec2.internal

openshift-ingress

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm to ip-10-0-134-28.ec2.internal

openshift-ingress

e2e-api-a-5ca190-openshift-default-6944747694-zwt8q

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-5ca190-openshift-default-6944747694-zwt8q to ip-10-0-134-28.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-5ca190-d58774db6-fgk9t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-5ca190-d58774db6-fgk9t to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b11aa3-56f89b656d-26sj4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b11aa3-56f89b656d-26sj4 to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-e2e-derive-14be608d-5d8cb5b95d-7ltdg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-14be608d-5d8cb5b95d-7ltdg to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-6ce027-854b75c788-5qt2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-6ce027-854b75c788-5qt2h to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6-bz829

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6-bz829 to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-09b0d2-5987f97588-qdf72

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-09b0d2-5987f97588-qdf72 to ip-10-0-141-85.ec2.internal

openshift-ingress

router-default-67c4d7bd47-tszsf

Scheduled

Successfully assigned openshift-ingress/router-default-67c4d7bd47-tszsf to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b64c39-f4f5c5674-jz96b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b64c39-f4f5c5674-jz96b to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-fba93c-5d587bf898-pslsn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-fba93c-5d587bf898-pslsn to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-55b321-7ff7b769f4-dkgqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-55b321-7ff7b769f4-dkgqr to ip-10-0-141-85.ec2.internal

openshift-ingress

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx to ip-10-0-136-247.ec2.internal

openshift-ingress

payload-processing-e2e-mt-671ba06b-6ff9c5f5c8-6fbcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-671ba06b-6ff9c5f5c8-6fbcn to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-e2e-mt-14e4ae87-7d9b795fc8-m8h42

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-14e4ae87-7d9b795fc8-m8h42 to ip-10-0-141-85.ec2.internal

openshift-ingress

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk to ip-10-0-134-28.ec2.internal

openshift-ingress

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

Scheduled

Successfully assigned openshift-ingress/e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm to ip-10-0-134-28.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-rq8zb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rq8zb to ip-10-0-141-85.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-06c66b-854885667d-v5nl8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-06c66b-854885667d-v5nl8 to ip-10-0-136-247.ec2.internal

openshift-ingress

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8 to ip-10-0-134-28.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-a6605e44-b759f5d5-xw5qq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a6605e44-b759f5d5-xw5qq to ip-10-0-141-85.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-67c4d7bd47 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-67c4d7bd47

FailedCreate

Error creating: pods "router-default-67c4d7bd47-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-67c4d7bd47

FailedCreate

Error creating: pods "router-default-67c4d7bd47-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-67c4d7bd47

SuccessfulCreate

Created pod: router-default-67c4d7bd47-tszsf
(x6)

openshift-ingress

kubelet

router-default-67c4d7bd47-tszsf

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-67c4d7bd47-tszsf

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-67c4d7bd47-tszsf

Created

Created container: router

openshift-ingress

kubelet

router-default-67c4d7bd47-tszsf

Started

Started container router

openshift-ingress

kubelet

router-default-67c4d7bd47-tszsf

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-67c4d7bd47-tszsf

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-95755dfb5

FailedCreate

Error creating: pods "kube-auth-proxy-95755dfb5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-95755dfb5

SuccessfulCreate

Created pod: kube-auth-proxy-95755dfb5-kmw2m

openshift-ingress

replicaset-controller

kube-auth-proxy-95755dfb5

SuccessfulCreate

Created pod: kube-auth-proxy-95755dfb5-nf8t8

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-95755dfb5 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-95755dfb5-nf8t8

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-95755dfb5-nf8t8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-95755dfb5-kmw2m

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-95755dfb5-kmw2m

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-rq8zb

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rq8zb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-rq8zb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-95755dfb5-kmw2m

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-95755dfb5-kmw2m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.832s (2.832s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-95755dfb5-kmw2m

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-95755dfb5-nf8t8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rq8zb

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-95755dfb5-nf8t8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 6.419s (6.419s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-95755dfb5-nf8t8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rq8zb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.96s (4.96s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rq8zb

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-g2m8j

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g2m8j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-lpl76

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lpl76

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rq8zb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rq8zb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-lpl76

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-g2m8j

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lpl76

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g2m8j

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g2m8j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.549s (3.549s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lpl76

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lpl76

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.746s (3.746s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-g2m8j

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rq8zb

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-rq8zb

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rq8zb

Unhealthy

Readiness probe failed: Get "http://10.133.0.24:8080/ready": dial tcp 10.133.0.24:8080: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rq8zb

ProbeError

Readiness probe error: Get "http://10.133.0.24:8080/ready": dial tcp 10.133.0.24:8080: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-jffhc

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-jffhc

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5692l

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-sfjl8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5cc6cd444b-5692l

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-5692l

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-sfjl8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-sfjl8

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-sfjl8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.272s (2.272s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-sfjl8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5692l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.21s (2.21s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-sfjl8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5692l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-5692l

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jffhc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jffhc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jffhc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jffhc

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jffhc

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ait-76aaf06c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-76aaf06c-openshift-default-594dd56856 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-76aaf06c-openshift-default-594dd56856

SuccessfulCreate

Created pod: e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

openshift-ingress

gateway_labeler_controller

e2e-ait-76aaf06c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-76aaf06c

openshift-ingress

multus

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4-6l6fp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-76aaf06c-bb948fdb8

FailedCreate

Error creating: pods "payload-processing-e2e-ait-76aaf06c-bb948fdb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-76aaf06c: serviceaccount "payload-processing-e2e-ait-76aaf06c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-76aaf06c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-76aaf06c-bb948fdb8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-76aaf06c: serviceaccount "payload-processing-e2e-ait-76aaf06c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-76aaf06c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-76aaf06c-bb948fdb8

SuccessfulCreate

Created pod: payload-processing-e2e-ait-76aaf06c-bb948fdb8-lcws9

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4-6l6fp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4-6l6fp

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-76aaf06c-bb948fdb8-lcws9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4-6l6fp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-76aaf06c-bb948fdb8-lcws9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-76aaf06c-bb948fdb8-lcws9

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-76aaf06c-bb948fdb8-lcws9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4-6l6fp

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-76aaf06c-b9cbd74d4-6l6fp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-76aaf06c-bb948fdb8-lcws9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-a6605e44-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a6605e44-gw

openshift-ingress

deployment-controller

e2e-migrate-a6605e44-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584

SuccessfulCreate

Created pod: e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

openshift-ingress

multus

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a6605e44

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a6605e44-b759f5d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a6605e44

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a6605e44-5655bc988d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-a6605e44-b759f5d5-xw5qq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a6605e44-b759f5d5-xw5qq

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a6605e44-b759f5d5

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a6605e44-b759f5d5-xw5qq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a6605e44-b759f5d5

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a6605e44-b759f5d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a6605e44: serviceaccount "payload-processing-e2e-migrate-a6605e44" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-a6605e44-b759f5d5-xw5qq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-a6605e44-b759f5d5-xw5qq

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a6605e44-5655bc988d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a6605e44-5655bc988d-b7g4m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a6605e44-5655bc988d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a6605e44-5655bc988d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a6605e44: serviceaccount "payload-processing-e2e-migrate-a6605e44" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a6605e44-5655bc988d-b7g4m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a6605e44-5655bc988d-b7g4m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a6605e44-5655bc988d-b7g4m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a6605e44-5655bc988d-b7g4m

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

Unhealthy

Readiness probe failed: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-76aaf06c-openshift-default-594dd56856-fh72k

ProbeError

Readiness probe error: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": read tcp 10.132.0.2:45990->10.132.0.42:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": read tcp 10.132.0.2:45990->10.132.0.42:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a6605e44-5655bc988d-b7g4m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a6605e44-b759f5d5-xw5qq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-095ac0a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-095ac0a0

openshift-ingress

deployment-controller

e2e-ait-095ac0a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-095ac0a0-openshift-default-75cfb7c474 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-095ac0a0-openshift-default-75cfb7c474

SuccessfulCreate

Created pod: e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.5s (2.5s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-a6605e44-gw-openshift-default-5f7cb8b584-2kksd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-095ac0a0-867854c55d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-095ac0a0-867854c55d-2x5df

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644-xmgpj

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-095ac0a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-095ac0a0-867854c55d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-095ac0a0-867854c55d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-095ac0a0: serviceaccount "payload-processing-e2e-ait-095ac0a0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-095ac0a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-095ac0a0-867854c55d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644-xmgpj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-095ac0a0: serviceaccount "payload-processing-e2e-ait-095ac0a0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644-xmgpj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644-xmgpj

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644-xmgpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-095ac0a0-867854c55d-2x5df

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-095ac0a0-867854c55d-2x5df

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-095ac0a0-867854c55d-2x5df

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-095ac0a0-867854c55d-2x5df

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

Created

Created container: istio-proxy
(x3)

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-095ac0a0-7fb77bd644-xmgpj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-095ac0a0-867854c55d-2x5df

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-14be608d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-14be608d-openshift-default-d888c6b44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-14be608d-openshift-default-d888c6b44

SuccessfulCreate

Created pod: e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-derive-14be608d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-14be608d

openshift-ingress

multus

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-095ac0a0-openshift-default-75cfb7c474-q6tc8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-14be608d-5d8cb5b95d

SuccessfulCreate

Created pod: payload-processing-e2e-derive-14be608d-5d8cb5b95d-7ltdg

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-14be608d-c6599f464-bm74k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-14be608d-5d8cb5b95d

FailedCreate

Error creating: pods "payload-processing-e2e-derive-14be608d-5d8cb5b95d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-14be608d: serviceaccount "payload-processing-e2e-derive-14be608d" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-14be608d-5d8cb5b95d-7ltdg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-14be608d-5d8cb5b95d-7ltdg

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-14be608d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-14be608d-5d8cb5b95d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-14be608d-c6599f464

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-14be608d-c6599f464-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-14be608d: serviceaccount "payload-processing-e2e-derive-14be608d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-14be608d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-14be608d-c6599f464 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-14be608d-c6599f464-bm74k

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-14be608d-c6599f464

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-14be608d-c6599f464-bm74k

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-14be608d-c6599f464-bm74k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-14be608d-c6599f464-bm74k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-14be608d-5d8cb5b95d-7ltdg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-14be608d-5d8cb5b95d-7ltdg

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-14be608d-5d8cb5b95d-7ltdg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-14be608d-c6599f464-bm74k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-14be608d-openshift-default-d888c6b44-vz5rm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-14e4ae87-openshift-default-75668d99bd

SuccessfulCreate

Created pod: e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

openshift-ingress

gateway_labeler_controller

e2e-mt-14e4ae87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-14e4ae87

openshift-ingress

deployment-controller

e2e-mt-14e4ae87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-14e4ae87-openshift-default-75668d99bd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-14e4ae87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-14e4ae87-7d9b795fc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-14e4ae87-7d9b795fc8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-14e4ae87-7d9b795fc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-14e4ae87: serviceaccount "payload-processing-e2e-mt-14e4ae87" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-14e4ae87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-14e4ae87-7d9b795fc8-m8h42

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-14e4ae87-7d9b795fc8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-14e4ae87-7d9b795fc8-m8h42

openshift-ingress

multus

payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44-k252t

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44-k252t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44-k252t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-14e4ae87: serviceaccount "payload-processing-e2e-mt-14e4ae87" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44-k252t

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44-k252t

openshift-ingress

multus

payload-processing-e2e-mt-14e4ae87-7d9b795fc8-m8h42

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-14e4ae87-7d9b795fc8-m8h42

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-14e4ae87-7d9b795fc8-m8h42

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-14e4ae87

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-14e4ae87: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-14e4ae87": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-14e4ae87, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ae9aa81-33f6-41ee-b743-f5a914e06f95, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-14e4ae87-7d9b795fc8-m8h42

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-14e4ae87-5986fc6f44-k252t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-14e4ae87-openshift-default-75668d99bd-q5lzk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-671ba06b-openshift-default-566ff47b

SuccessfulCreate

Created pod: e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

openshift-ingress

deployment-controller

e2e-mt-671ba06b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-671ba06b-openshift-default-566ff47b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-671ba06b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-671ba06b

openshift-ingress

multus

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-671ba06b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-671ba06b-6ff9c5f5c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-671ba06b-6ff9c5f5c8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-671ba06b-6ff9c5f5c8-6fbcn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-671ba06b-6ff9c5f5c8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-671ba06b-6ff9c5f5c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-671ba06b: serviceaccount "payload-processing-e2e-mt-671ba06b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-671ba06b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-671ba06b-74776589d8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-671ba06b-74776589d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-671ba06b-74776589d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-671ba06b: serviceaccount "payload-processing-e2e-mt-671ba06b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-671ba06b-74776589d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-671ba06b-74776589d8-zgn7s

openshift-ingress

multus

payload-pre-processing-e2e-mt-671ba06b-74776589d8-zgn7s

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-671ba06b-6ff9c5f5c8-6fbcn

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-671ba06b-6ff9c5f5c8-6fbcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-671ba06b-6ff9c5f5c8-6fbcn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-671ba06b-6ff9c5f5c8-6fbcn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-671ba06b-74776589d8-zgn7s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-671ba06b-74776589d8-zgn7s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-671ba06b-74776589d8-zgn7s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-671ba06b-6ff9c5f5c8-6fbcn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-671ba06b-74776589d8-zgn7s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-671ba06b-openshift-default-566ff47b-k6jlm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-6ce027

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-6ce027

openshift-ingress

deployment-controller

e2e-inf-a-6ce027-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6ce027-openshift-default-59dfc7d89b from 0 to 1

openshift-ingress

multus

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-6ce027-openshift-default-59dfc7d89b

SuccessfulCreate

Created pod: e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6ce027-78bffbb456

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-6ce027-78bffbb456-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6ce027: serviceaccount "payload-processing-e2e-inf-a-6ce027" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6ce027-854b75c788

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-6ce027-854b75c788-5qt2h
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6ce027-854b75c788

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-6ce027-854b75c788-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6ce027: serviceaccount "payload-processing-e2e-inf-a-6ce027" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-6ce027

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-6ce027-854b75c788 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-6ce027

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-6ce027-78bffbb456 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6ce027-78bffbb456

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-6ce027-78bffbb456-vpkhc

openshift-ingress

multus

payload-processing-e2e-inf-a-6ce027-854b75c788-5qt2h

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6ce027-854b75c788-5qt2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6ce027-78bffbb456-vpkhc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6ce027-78bffbb456-vpkhc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6ce027-78bffbb456-vpkhc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6ce027-854b75c788-5qt2h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6ce027-854b75c788-5qt2h

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-6ce027-78bffbb456-vpkhc

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

ProbeError

Readiness probe error: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

Unhealthy

Readiness probe failed: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-b2ddd3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b2ddd3

openshift-ingress

replicaset-controller

e2e-inf-b-b2ddd3-openshift-default-5645956f74

SuccessfulCreate

Created pod: e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

openshift-ingress

deployment-controller

e2e-inf-b-b2ddd3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b2ddd3-openshift-default-5645956f74 from 0 to 1

openshift-ingress

multus

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-b2ddd3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6-bz829

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b-sw2nm

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b-sw2nm

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b-sw2nm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b-sw2nm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b-sw2nm

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6-bz829

openshift-ingress

multus

payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6-bz829

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6-bz829

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-b2ddd3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b2ddd3: serviceaccount "payload-processing-e2e-inf-b-b2ddd3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b2ddd3: serviceaccount "payload-processing-e2e-inf-b-b2ddd3" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6-bz829

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": read tcp 10.132.0.2:53754->10.132.0.43:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": read tcp 10.132.0.2:53754->10.132.0.43:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6ce027-854b75c788-5qt2h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6ce027-78bffbb456-vpkhc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-6ce027-openshift-default-59dfc7d89b-kckdl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b2ddd3-fbc6597b-sw2nm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b2ddd3-6646ccb4d6-bz829

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-api-a-5ca190-openshift-default-6944747694

SuccessfulCreate

Created pod: e2e-api-a-5ca190-openshift-default-6944747694-zwt8q

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-b2ddd3-openshift-default-5645956f74-c45dt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-5ca190

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-5ca190

openshift-ingress

deployment-controller

e2e-api-a-5ca190-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-5ca190-openshift-default-6944747694 from 0 to 1

openshift-ingress

multus

e2e-api-a-5ca190-openshift-default-6944747694-zwt8q

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5ca190-d58774db6

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-5ca190-d58774db6-fgk9t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5ca190-846b74dbfb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-5ca190-846b74dbfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5ca190: serviceaccount "payload-processing-e2e-api-a-5ca190" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-5ca190

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-5ca190-d58774db6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5ca190-d58774db6

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-5ca190-d58774db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5ca190: serviceaccount "payload-processing-e2e-api-a-5ca190" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-5ca190

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-5ca190-846b74dbfb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5ca190-846b74dbfb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-5ca190-846b74dbfb-tqj9p

openshift-ingress

multus

payload-processing-e2e-api-a-5ca190-d58774db6-fgk9t

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5ca190-846b74dbfb-tqj9p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5ca190-846b74dbfb-tqj9p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5ca190-846b74dbfb-tqj9p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-5ca190-846b74dbfb-tqj9p

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-5ca190-d58774db6-fgk9t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5ca190-d58774db6-fgk9t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5ca190-d58774db6-fgk9t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-5ca190-openshift-default-6944747694-zwt8q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-5ca190-openshift-default-6944747694-zwt8q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-5ca190-openshift-default-6944747694-zwt8q

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-5ca190-openshift-default-6944747694-zwt8q

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-5ca190-openshift-default-6944747694-zwt8q

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-b11aa3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b11aa3

openshift-ingress

deployment-controller

e2e-api-b-b11aa3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b11aa3-openshift-default-79d474bbd8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-b11aa3-openshift-default-79d474bbd8

SuccessfulCreate

Created pod: e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

openshift-ingress

multus

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b11aa3-56f89b656d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b11aa3-56f89b656d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b11aa3: serviceaccount "payload-processing-e2e-api-b-b11aa3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b11aa3-56f89b656d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b11aa3-56f89b656d-26sj4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b11aa3-84998f9b56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b11aa3-84998f9b56-v9zr5

openshift-ingress

kubelet

payload-processing-e2e-api-b-b11aa3-56f89b656d-26sj4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b11aa3-56f89b656d-26sj4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b11aa3-56f89b656d-26sj4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-b11aa3-56f89b656d-26sj4

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b11aa3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b11aa3-56f89b656d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b11aa3-84998f9b56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b11aa3-84998f9b56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b11aa3: serviceaccount "payload-processing-e2e-api-b-b11aa3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b11aa3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b11aa3-84998f9b56 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b11aa3-84998f9b56-v9zr5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b11aa3-84998f9b56-v9zr5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b11aa3-84998f9b56-v9zr5

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b11aa3-84998f9b56-v9zr5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5ca190-846b74dbfb-tqj9p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5ca190-d58774db6-fgk9t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-5ca190-openshift-default-6944747694-zwt8q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b11aa3-84998f9b56-v9zr5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b11aa3-56f89b656d-26sj4

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-a-55b321-openshift-default-6448f9b46d

SuccessfulCreate

Created pod: e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

openshift-ingress

deployment-controller

e2e-shared-a-55b321-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-55b321-openshift-default-6448f9b46d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-55b321

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-55b321

openshift-ingress

kubelet

e2e-api-b-b11aa3-openshift-default-79d474bbd8-5glqx

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-55b321-c7fb48d76

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-55b321-c7fb48d76-qgdgk

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-55b321-c7fb48d76-qgdgk

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-55b321-7ff7b769f4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-55b321-7ff7b769f4-dkgqr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-55b321-7ff7b769f4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-55b321-7ff7b769f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-55b321: serviceaccount "payload-processing-e2e-shared-a-55b321" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-55b321-c7fb48d76-qgdgk

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-55b321-c7fb48d76

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-55b321-c7fb48d76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-55b321: serviceaccount "payload-processing-e2e-shared-a-55b321" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-55b321

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-55b321-7ff7b769f4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-55b321

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-55b321-c7fb48d76 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-55b321-7ff7b769f4-dkgqr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-55b321-7ff7b769f4-dkgqr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-55b321-7ff7b769f4-dkgqr

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-55b321-c7fb48d76-qgdgk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-55b321-c7fb48d76-qgdgk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-55b321-7ff7b769f4-dkgqr

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-fba93c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-fba93c

openshift-ingress

replicaset-controller

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4

SuccessfulCreate

Created pod: e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

openshift-ingress

deployment-controller

e2e-shared-b-fba93c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-fba93c-5c946cf868

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-fba93c-5c946cf868-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-fba93c: serviceaccount "payload-processing-e2e-shared-b-fba93c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-fba93c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-fba93c-5d587bf898 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-fba93c-5d587bf898

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-fba93c-5d587bf898-pslsn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-fba93c-5d587bf898

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-fba93c-5d587bf898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-fba93c: serviceaccount "payload-processing-e2e-shared-b-fba93c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-fba93c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-fba93c-5c946cf868 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-fba93c-5c946cf868

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-fba93c-5c946cf868-lppnd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-fba93c-5c946cf868-lppnd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-fba93c-5c946cf868-lppnd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-fba93c-5d587bf898-pslsn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-fba93c-5d587bf898-pslsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-fba93c-5d587bf898-pslsn

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-fba93c-5c946cf868-lppnd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-fba93c-5c946cf868-lppnd

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-fba93c-5d587bf898-pslsn

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-09b0d2-openshift-default-584b576fdd

SuccessfulCreate

Created pod: e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-09b0d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-09b0d2

openshift-ingress

deployment-controller

e2e-ipp-a-09b0d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-09b0d2-openshift-default-584b576fdd from 0 to 1

openshift-ingress

multus

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556-p64vz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-09b0d2: serviceaccount "payload-processing-e2e-ipp-a-09b0d2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-09b0d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-09b0d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-09b0d2-5987f97588 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-09b0d2-5987f97588

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-09b0d2-5987f97588-qdf72
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-09b0d2-5987f97588

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-09b0d2-5987f97588-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-09b0d2: serviceaccount "payload-processing-e2e-ipp-a-09b0d2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556-p64vz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556-p64vz

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-09b0d2-5987f97588-qdf72

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-09b0d2-5987f97588-qdf72

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-09b0d2-5987f97588-qdf72

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556-p64vz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-09b0d2-5987f97588-qdf72

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556-p64vz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b64c39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b64c39

openshift-ingress

replicaset-controller

e2e-ipp-b-b64c39-openshift-default-fdd4855d6

SuccessfulCreate

Created pod: e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

openshift-ingress

deployment-controller

e2e-ipp-b-b64c39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b64c39-openshift-default-fdd4855d6 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b64c39-f4f5c5674

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b64c39-f4f5c5674-jz96b

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b64c39-f4f5c5674-jz96b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-kk9td

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-kk9td

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b64c39-f4f5c5674

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b64c39-f4f5c5674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b64c39: serviceaccount "payload-processing-e2e-ipp-b-b64c39" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b64c39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b64c39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b64c39-f4f5c5674 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b64c39: serviceaccount "payload-processing-e2e-ipp-b-b64c39" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-kk9td

openshift-ingress

multus

payload-processing-e2e-ipp-b-b64c39-f4f5c5674-jz96b

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b64c39-f4f5c5674-jz96b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b64c39-f4f5c5674-jz96b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-kk9td

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-kk9td

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-kk9td

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.598s (2.598s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-06c66b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-06c66b

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74

SuccessfulCreate

Created pod: e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

openshift-ingress

deployment-controller

e2e-ipp-cleanup-06c66b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-06c66b-openshift-default-c96675c74 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b-zpffv

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-06c66b-854885667d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-06c66b-854885667d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-06c66b: serviceaccount "payload-processing-e2e-ipp-cleanup-06c66b" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-06c66b-854885667d-v5nl8

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-06c66b: serviceaccount "payload-processing-e2e-ipp-cleanup-06c66b" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-06c66b-854885667d-v5nl8

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-06c66b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-06c66b-854885667d-v5nl8

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-06c66b-854885667d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-06c66b-854885667d-v5nl8

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-06c66b-854885667d-v5nl8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b-zpffv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b-zpffv

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b-zpffv

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-06c66b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-06c66b-854885667d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b-zpffv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-06c66b-854885667d-v5nl8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-06c66b-bfc79585b-zpffv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-06c66b-openshift-default-c96675c74-pffmq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-09b0d2-5987f97588-qdf72

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-09b0d2-96bc9d556-p64vz

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-09b0d2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-09b0d2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-09b0d2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-09b0d2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 99c4f1a9-43c9-482c-ad0a-be1b5d8e705c, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-09b0d2-openshift-default-584b576fdd-7rb26

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b64c39-c9b98c4fb-kk9td

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b64c39-f4f5c5674-jz96b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-b64c39-openshift-default-fdd4855d6-5st2g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-55b321-c7fb48d76-qgdgk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-55b321-7ff7b769f4-dkgqr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-55b321-openshift-default-6448f9b46d-g57vn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-fba93c-5c946cf868-lppnd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-fba93c-5d587bf898-pslsn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-fba93c-openshift-default-5bb4f7dbb4-97mhg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: