Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch to ip-10-0-129-35.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6d92f36d-7884c8cc78-f6zcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6d92f36d-7884c8cc78-f6zcf to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29 to ip-10-0-129-103.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-zfw2x

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x to ip-10-0-129-35.ec2.internal

openshift-ingress

e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7 to ip-10-0-135-99.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-rqd4p

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqd4p to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v to ip-10-0-135-99.ec2.internal

openshift-ingress

kube-auth-proxy-789f49c94d-6988f

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-789f49c94d-6988f to ip-10-0-135-99.ec2.internal

openshift-ingress

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm to ip-10-0-129-103.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-t58pg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t58pg to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk to ip-10-0-135-99.ec2.internal

openshift-ingress

kube-auth-proxy-789f49c94d-rq8fr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-789f49c94d-rq8fr to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv to ip-10-0-129-103.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-5jk8x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-5jk8x to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-vw2r7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-vw2r7 to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w to ip-10-0-135-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b-vpjdw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b-vpjdw to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-193600d6-7f45485848-tmngb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-193600d6-7f45485848-tmngb to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-320e6c-55dcb57574-2nths

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-320e6c-55dcb57574-2nths to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-906a2829-79988bcb76-jk9cl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-906a2829-79988bcb76-jk9cl to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-193600d6-openshift-default-bf88d878-lhtlb to ip-10-0-135-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb-lfdzh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb-lfdzh to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-320e6c-546796b84-86ps9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-320e6c-546796b84-86ps9 to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x to ip-10-0-129-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8 to ip-10-0-129-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh to ip-10-0-129-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-842d4926-5fc6f94544-rd5fd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-842d4926-5fc6f94544-rd5fd to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5e11b867-6db759fc48-cqhvv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5e11b867-6db759fc48-cqhvv to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6d92f36d-59688cd976-5kbh6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6d92f36d-59688cd976-5kbh6 to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk to ip-10-0-129-35.ec2.internal

openshift-ingress

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk to ip-10-0-135-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7 to ip-10-0-129-35.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-j8tq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-j8tq2 to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s to ip-10-0-135-99.ec2.internal

openshift-ingress

e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz

Scheduled

Successfully assigned openshift-ingress/e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz to ip-10-0-135-99.ec2.internal

openshift-ingress

payload-processing-e2e-ait-02d4b958-98444579b-xp6g8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-02d4b958-98444579b-xp6g8 to ip-10-0-129-103.ec2.internal

openshift-ingress

router-default-54fd59887f-g5zgr

Scheduled

Successfully assigned openshift-ingress/router-default-54fd59887f-g5zgr to ip-10-0-129-35.ec2.internal

openshift-ingress

router-default-54fd59887f-g5zgr

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-api-a-88f354-7544855dfb-69vmk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-88f354-7544855dfb-69vmk to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-ab0ae6-579745dff8-6sk7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-ab0ae6-579745dff8-6sk7d to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-299af2-865774ff5d-x572k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k to ip-10-0-129-35.ec2.internal

openshift-ingress

e2e-inf-b-320e6c-openshift-default-6769647446-khs4t

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-320e6c-openshift-default-6769647446-khs4t to ip-10-0-135-99.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5e11b867-cdf959b54-rmlsm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5e11b867-cdf959b54-rmlsm to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-842d4926-76d68b9669-slz7z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-842d4926-76d68b9669-slz7z to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt to ip-10-0-129-35.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t to ip-10-0-129-35.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62 to ip-10-0-129-35.ec2.internal

openshift-ingress

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm to ip-10-0-135-99.ec2.internal

openshift-ingress

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8-6fddv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8-6fddv to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-derive-906a2829-86cb56dd58-vsqsh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-906a2829-86cb56dd58-vsqsh to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-393e3a-86cc879ffd-79knv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-393e3a-86cc879ffd-79knv to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-88f354-85fc786bbd-zz985

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-88f354-85fc786bbd-zz985 to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-ait-193600d6-5fffb4c98-rlnz7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-193600d6-5fffb4c98-rlnz7 to ip-10-0-129-103.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-54fd59887f from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-54fd59887f

FailedCreate

Error creating: pods "router-default-54fd59887f-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-54fd59887f

FailedCreate

Error creating: pods "router-default-54fd59887f-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-54fd59887f

SuccessfulCreate

Created pod: router-default-54fd59887f-g5zgr
(x6)

openshift-ingress

kubelet

router-default-54fd59887f-g5zgr

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-54fd59887f-g5zgr

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-54fd59887f-g5zgr

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-54fd59887f-g5zgr

Started

Started container router

openshift-ingress

kubelet

router-default-54fd59887f-g5zgr

Created

Created container: router

openshift-ingress

kubelet

router-default-54fd59887f-g5zgr

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-789f49c94d from 0 to 2
(x6)

openshift-ingress

replicaset-controller

kube-auth-proxy-789f49c94d

FailedCreate

Error creating: pods "kube-auth-proxy-789f49c94d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-rq8fr

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-789f49c94d

SuccessfulCreate

Created pod: kube-auth-proxy-789f49c94d-6988f

openshift-ingress

replicaset-controller

kube-auth-proxy-789f49c94d

SuccessfulCreate

Created pod: kube-auth-proxy-789f49c94d-rq8fr

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-6988f

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-6988f

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-789f49c94d-rq8fr

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-rqd4p

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rqd4p

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

kube-auth-proxy-789f49c94d-6988f

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-rq8fr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-rqd4p

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-6988f

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-6988f

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-6988f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.495s (2.495s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-rq8fr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-rq8fr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-789f49c94d-rq8fr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.106s (4.106s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rqd4p

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rqd4p

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rqd4p

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.738s (5.738s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rqd4p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-zfw2x

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-t58pg

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-zfw2x

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rqd4p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zfw2x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-t58pg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-t58pg

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zfw2x

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zfw2x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.166s (3.166s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zfw2x

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-t58pg

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zfw2x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-t58pg

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-zfw2x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-t58pg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.589s (2.589s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rqd4p

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-rqd4p
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-5jk8x

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-5jk8x

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-vw2r7

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-j8tq2

openshift-ingress

multus

payload-processing-5cc6cd444b-j8tq2

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-vw2r7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5cc6cd444b-j8tq2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-vw2r7

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-vw2r7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.167s (3.167s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-j8tq2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-j8tq2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-j8tq2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.136s (3.136s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-vw2r7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-vw2r7

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5jk8x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5jk8x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5jk8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5jk8x

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-5jk8x

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-02d4b958

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-02d4b958

openshift-ingress

deployment-controller

e2e-ait-02d4b958-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-02d4b958-openshift-default-849655f9d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-02d4b958-openshift-default-849655f9d4

SuccessfulCreate

Created pod: e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

openshift-ingress

multus

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b-vpjdw

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-02d4b958: serviceaccount "payload-processing-e2e-ait-02d4b958" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-02d4b958

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-02d4b958-98444579b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-02d4b958-98444579b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-02d4b958-98444579b-xp6g8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-02d4b958-98444579b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-02d4b958-98444579b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-02d4b958: serviceaccount "payload-processing-e2e-ait-02d4b958" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-02d4b958-98444579b-xp6g8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-02d4b958-98444579b-xp6g8

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-02d4b958

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b-vpjdw

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b-vpjdw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-02d4b958-98444579b-xp6g8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-02d4b958-98444579b-xp6g8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b-vpjdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b-vpjdw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-02d4b958-6f6f9f4d5b-vpjdw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-02d4b958-98444579b-xp6g8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-02d4b958-openshift-default-849655f9d4-mqgcm

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

e2e-migrate-842d4926-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-842d4926-gw

openshift-ingress

deployment-controller

e2e-migrate-842d4926-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-842d4926-gw-openshift-default-548d9575b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-842d4926-gw-openshift-default-548d9575b8

SuccessfulCreate

Created pod: e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

openshift-ingress

kubelet

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.586s (3.586s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-842d4926

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-842d4926-76d68b9669 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-842d4926

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-842d4926-5fc6f94544 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-842d4926-5fc6f94544-rd5fd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-842d4926-5fc6f94544-rd5fd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-842d4926-76d68b9669-slz7z

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-842d4926-5fc6f94544

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-842d4926-5fc6f94544-rd5fd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-842d4926-5fc6f94544

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-842d4926-5fc6f94544-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-842d4926: serviceaccount "payload-processing-e2e-migrate-842d4926" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-842d4926-5fc6f94544-rd5fd

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-842d4926-76d68b9669

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-842d4926-76d68b9669-slz7z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-842d4926-76d68b9669

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-842d4926-76d68b9669-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-842d4926: serviceaccount "payload-processing-e2e-migrate-842d4926" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-842d4926-76d68b9669-slz7z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-842d4926-76d68b9669-slz7z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-842d4926-76d68b9669-slz7z

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-842d4926-5fc6f94544-rd5fd

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-842d4926-76d68b9669-slz7z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-842d4926-5fc6f94544-rd5fd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-842d4926-gw-openshift-default-548d9575b8-x5hxk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-193600d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-193600d6

openshift-ingress

deployment-controller

e2e-ait-193600d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-193600d6-openshift-default-bf88d878 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-193600d6-openshift-default-bf88d878

SuccessfulCreate

Created pod: e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

openshift-ingress

multus

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-193600d6-7f45485848-tmngb

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-193600d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-193600d6-7f45485848 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-193600d6-7f45485848-tmngb

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-193600d6-7f45485848-tmngb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-193600d6-7f45485848

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-193600d6-7f45485848-tmngb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-193600d6-7f45485848

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-193600d6-7f45485848-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-193600d6: serviceaccount "payload-processing-e2e-ait-193600d6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-193600d6-7f45485848-tmngb

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-193600d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-193600d6-5fffb4c98 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-193600d6-5fffb4c98

SuccessfulCreate

Created pod: payload-processing-e2e-ait-193600d6-5fffb4c98-rlnz7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-193600d6-5fffb4c98

FailedCreate

Error creating: pods "payload-processing-e2e-ait-193600d6-5fffb4c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-193600d6: serviceaccount "payload-processing-e2e-ait-193600d6" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-193600d6-5fffb4c98-rlnz7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-193600d6-5fffb4c98-rlnz7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-193600d6-5fffb4c98-rlnz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-193600d6-5fffb4c98-rlnz7

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-193600d6-7f45485848-tmngb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-193600d6-5fffb4c98-rlnz7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-193600d6-openshift-default-bf88d878-lhtlb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-906a2829

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-906a2829

openshift-ingress

deployment-controller

e2e-derive-906a2829-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-906a2829-openshift-default-5f7bc5cd7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-906a2829-openshift-default-5f7bc5cd7b

SuccessfulCreate

Created pod: e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz

openshift-ingress

multus

e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-906a2829-86cb56dd58

SuccessfulCreate

Created pod: payload-processing-e2e-derive-906a2829-86cb56dd58-vsqsh

openshift-ingress

deployment-controller

payload-processing-e2e-derive-906a2829

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-906a2829-86cb56dd58 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-906a2829

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-906a2829-79988bcb76 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-906a2829-79988bcb76

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-906a2829-79988bcb76-jk9cl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-906a2829-79988bcb76

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-906a2829-79988bcb76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-906a2829: serviceaccount "payload-processing-e2e-derive-906a2829" not found

openshift-ingress

multus

payload-processing-e2e-derive-906a2829-86cb56dd58-vsqsh

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-906a2829-79988bcb76-jk9cl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-906a2829-79988bcb76-jk9cl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-906a2829-79988bcb76-jk9cl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-906a2829-79988bcb76-jk9cl

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-906a2829-86cb56dd58-vsqsh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-906a2829-86cb56dd58-vsqsh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-906a2829-86cb56dd58-vsqsh

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-906a2829-86cb56dd58

FailedCreate

Error creating: pods "payload-processing-e2e-derive-906a2829-86cb56dd58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-906a2829: serviceaccount "payload-processing-e2e-derive-906a2829" not found
(x2)

openshift-ingress

kubelet

e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-906a2829-86cb56dd58-vsqsh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-906a2829-79988bcb76-jk9cl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-906a2829-openshift-default-5f7bc5cd7b-wksbz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-6d92f36d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6d92f36d-openshift-default-895f7999b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-6d92f36d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6d92f36d

openshift-ingress

replicaset-controller

e2e-mt-6d92f36d-openshift-default-895f7999b

SuccessfulCreate

Created pod: e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7

openshift-ingress

multus

e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6d92f36d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6d92f36d-7884c8cc78 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6d92f36d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6d92f36d-59688cd976 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-6d92f36d-7884c8cc78-f6zcf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6d92f36d-7884c8cc78-f6zcf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-6d92f36d-7884c8cc78-f6zcf

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6d92f36d-7884c8cc78-f6zcf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d92f36d-59688cd976-5kbh6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-6d92f36d-59688cd976-5kbh6

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d92f36d-7884c8cc78

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6d92f36d-7884c8cc78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d92f36d: serviceaccount "payload-processing-e2e-mt-6d92f36d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d92f36d-7884c8cc78

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6d92f36d-7884c8cc78-f6zcf

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d92f36d-59688cd976-5kbh6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d92f36d-59688cd976-5kbh6

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d92f36d-59688cd976

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6d92f36d-59688cd976-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d92f36d: serviceaccount "payload-processing-e2e-mt-6d92f36d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d92f36d-59688cd976

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6d92f36d-59688cd976-5kbh6
(x2)

openshift-ingress

kubelet

e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d92f36d-59688cd976-5kbh6

Unhealthy

Readiness probe failed: dial tcp 10.134.0.54:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d92f36d-59688cd976-5kbh6

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-6d92f36d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-6d92f36d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-6d92f36d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-6d92f36d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f574ec27-900e-4000-ab8a-6e1e1ff69e86, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-6d92f36d-7884c8cc78-f6zcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-6d92f36d-openshift-default-895f7999b-xxvb7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-5e11b867-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5e11b867-openshift-default-6c669f76f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-5e11b867

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5e11b867

openshift-ingress

multus

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-5e11b867-openshift-default-6c669f76f6

SuccessfulCreate

Created pod: e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

openshift-ingress

multus

payload-pre-processing-e2e-mt-5e11b867-6db759fc48-cqhvv

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5e11b867-6db759fc48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5e11b867-6db759fc48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5e11b867: serviceaccount "payload-processing-e2e-mt-5e11b867" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5e11b867-cdf959b54

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5e11b867-cdf959b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5e11b867: serviceaccount "payload-processing-e2e-mt-5e11b867" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-5e11b867-cdf959b54-rmlsm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5e11b867-cdf959b54-rmlsm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5e11b867

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5e11b867-6db759fc48 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5e11b867-6db759fc48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5e11b867-6db759fc48-cqhvv

openshift-ingress

kubelet

payload-processing-e2e-mt-5e11b867-cdf959b54-rmlsm

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5e11b867

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5e11b867-cdf959b54 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-5e11b867-cdf959b54-rmlsm

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5e11b867-6db759fc48-cqhvv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5e11b867-cdf959b54

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5e11b867-cdf959b54-rmlsm

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5e11b867-6db759fc48-cqhvv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5e11b867-6db759fc48-cqhvv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5e11b867-6db759fc48-cqhvv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5e11b867-cdf959b54-rmlsm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-5e11b867-openshift-default-6c669f76f6-2pn9v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-df5e5d-openshift-default-569f88687b

SuccessfulCreate

Created pod: e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

openshift-ingress

deployment-controller

e2e-inf-a-df5e5d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-df5e5d-openshift-default-569f88687b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-df5e5d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-df5e5d

openshift-ingress

multus

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-df5e5d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-df5e5d: serviceaccount "payload-processing-e2e-inf-a-df5e5d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-df5e5d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8-6fddv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb-lfdzh

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb-lfdzh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb-lfdzh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb-lfdzh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb-lfdzh

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-df5e5d: serviceaccount "payload-processing-e2e-inf-a-df5e5d" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8-6fddv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8-6fddv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8-6fddv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8-6fddv

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-320e6c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-320e6c

openshift-ingress

deployment-controller

e2e-inf-b-320e6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-320e6c-openshift-default-6769647446 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-320e6c-openshift-default-6769647446

SuccessfulCreate

Created pod: e2e-inf-b-320e6c-openshift-default-6769647446-khs4t

openshift-ingress

multus

e2e-inf-b-320e6c-openshift-default-6769647446-khs4t

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-320e6c-546796b84

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-320e6c-546796b84-86ps9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-320e6c-546796b84

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-320e6c-546796b84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-320e6c: serviceaccount "payload-processing-e2e-inf-b-320e6c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-320e6c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-320e6c-546796b84 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-320e6c-546796b84-86ps9

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-320e6c-55dcb57574

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-320e6c-55dcb57574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-320e6c: serviceaccount "payload-processing-e2e-inf-b-320e6c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-320e6c-55dcb57574

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-320e6c-55dcb57574-2nths

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-320e6c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-320e6c-55dcb57574 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-320e6c-546796b84-86ps9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-320e6c-546796b84-86ps9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-320e6c-546796b84-86ps9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-320e6c-55dcb57574-2nths

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-320e6c-55dcb57574-2nths

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-320e6c-55dcb57574-2nths

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-320e6c-55dcb57574-2nths

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-320e6c-openshift-default-6769647446-khs4t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-320e6c-openshift-default-6769647446-khs4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-320e6c-openshift-default-6769647446-khs4t

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-320e6c-openshift-default-6769647446-khs4t

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-320e6c-openshift-default-6769647446-khs4t

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-df5e5d-5bbdc5cfb-lfdzh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-df5e5d-5fd4f45cd8-6fddv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-df5e5d-openshift-default-569f88687b-6rwqk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-320e6c-546796b84-86ps9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-320e6c-55dcb57574-2nths

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-320e6c-openshift-default-6769647446-khs4t

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-88f354-openshift-default-84c5d97dd8

SuccessfulCreate

Created pod: e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

openshift-ingress

deployment-controller

e2e-api-a-88f354-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-88f354-openshift-default-84c5d97dd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-88f354

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-88f354

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-88f354

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-88f354-7544855dfb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-88f354-85fc786bbd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-88f354-85fc786bbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-88f354: serviceaccount "payload-processing-e2e-api-a-88f354" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-88f354-85fc786bbd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-88f354-85fc786bbd-zz985

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-88f354

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-88f354-85fc786bbd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-88f354-7544855dfb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-88f354-7544855dfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-88f354: serviceaccount "payload-processing-e2e-api-a-88f354" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-88f354-7544855dfb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-88f354-7544855dfb-69vmk

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88f354-7544855dfb-69vmk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-88f354-7544855dfb-69vmk

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-88f354-85fc786bbd-zz985

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-88f354-85fc786bbd-zz985

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88f354-7544855dfb-69vmk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88f354-7544855dfb-69vmk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-88f354-85fc786bbd-zz985

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-88f354-85fc786bbd-zz985

Started

Started container payload-processing

openshift-ingress

multus

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-393e3a-openshift-default-65775d6674

SuccessfulCreate

Created pod: e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

openshift-ingress

deployment-controller

e2e-api-b-393e3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-393e3a-openshift-default-65775d6674 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-393e3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-393e3a

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-393e3a-86cc879ffd

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-393e3a-86cc879ffd-79knv

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-393e3a-55c94757f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-393e3a-55c94757f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-393e3a: serviceaccount "payload-processing-e2e-api-b-393e3a" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-393e3a-86cc879ffd-79knv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-393e3a-55c94757f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-393e3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-393e3a-86cc879ffd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-393e3a-86cc879ffd-79knv

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-393e3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-393e3a-55c94757f6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-393e3a-86cc879ffd-79knv

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-393e3a-86cc879ffd

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-393e3a-86cc879ffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-393e3a: serviceaccount "payload-processing-e2e-api-b-393e3a" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-393e3a-86cc879ffd-79knv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.658s (1.658s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

ProbeError

Readiness probe error: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

Unhealthy

Readiness probe failed: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-88f354-85fc786bbd-zz985

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-88f354-7544855dfb-69vmk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

Unhealthy

Readiness probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-88f354-openshift-default-84c5d97dd8-96w8s

ProbeError

Readiness probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-393e3a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-393e3a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-393e3a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-393e3a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3b1f37de-b2ba-4585-a176-d364909b2f7f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-393e3a-86cc879ffd-79knv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-393e3a-openshift-default-65775d6674-wrs4w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-299af2-openshift-default-7fd54df7b8

SuccessfulCreate

Created pod: e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

openshift-ingress

gateway_labeler_controller

e2e-shared-a-299af2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-299af2

openshift-ingress

deployment-controller

e2e-shared-a-299af2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-299af2-openshift-default-7fd54df7b8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-299af2-865774ff5d-x572k

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-299af2-865774ff5d-x572k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-299af2-865774ff5d-x572k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-299af2-865774ff5d-x572k

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-299af2-865774ff5d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-299af2-865774ff5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-299af2: serviceaccount "payload-processing-e2e-shared-a-299af2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-299af2-865774ff5d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-299af2-865774ff5d-x572k

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-299af2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-299af2-865774ff5d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-299af2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-299af2-65d57c848d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-299af2-65d57c848d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-299af2-65d57c848d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-299af2-65d57c848d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-299af2: serviceaccount "payload-processing-e2e-shared-a-299af2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-ab0ae6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-ab0ae6

openshift-ingress

replicaset-controller

e2e-shared-b-ab0ae6-openshift-default-59fc8c788

SuccessfulCreate

Created pod: e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

openshift-ingress

deployment-controller

e2e-shared-b-ab0ae6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-ab0ae6-openshift-default-59fc8c788 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-ab0ae6

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-ab0ae6-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-ab0ae6-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-ab0ae6: serviceaccount "payload-processing-e2e-shared-b-ab0ae6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-ab0ae6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-ab0ae6-579745dff8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-ab0ae6-579745dff8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-ab0ae6-579745dff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-ab0ae6: serviceaccount "payload-processing-e2e-shared-b-ab0ae6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-ab0ae6-579745dff8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-ab0ae6-579745dff8-6sk7d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-ab0ae6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-ab0ae6-579745dff8-6sk7d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-ab0ae6-579745dff8-6sk7d

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-ab0ae6-579745dff8-6sk7d

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-ab0ae6-579745dff8-6sk7d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": read tcp 10.134.0.2:43090->10.134.0.66:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": read tcp 10.134.0.2:43090->10.134.0.66:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e22c40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e22c40

openshift-ingress

deployment-controller

e2e-ipp-a-e22c40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e22c40-openshift-default-5cb96bb486 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-e22c40-openshift-default-5cb96bb486

SuccessfulCreate

Created pod: e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e22c40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e22c40: serviceaccount "payload-processing-e2e-ipp-a-e22c40" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e22c40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e22c40-546577f5b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e22c40-546577f5b6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e22c40-546577f5b6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e22c40-546577f5b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e22c40: serviceaccount "payload-processing-e2e-ipp-a-e22c40" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-d66e66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d66e66-openshift-default-6f77476bbb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d66e66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d66e66

openshift-ingress

kubelet

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

ProbeError

Readiness probe error: Get "http://10.133.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-ipp-b-d66e66-openshift-default-6f77476bbb

SuccessfulCreate

Created pod: e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

openshift-ingress

kubelet

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

Unhealthy

Readiness probe failed: Get "http://10.133.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d66e66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d66e66: serviceaccount "payload-processing-e2e-ipp-b-d66e66" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d66e66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d66e66-6688874d6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d66e66-6688874d6b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d66e66-6688874d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d66e66: serviceaccount "payload-processing-e2e-ipp-b-d66e66" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d66e66-6688874d6b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x4)

openshift-ingress

kubelet

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-cleanup-a585ca

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-cleanup-a585ca-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-cleanup-a585ca-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-a585ca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-a585ca

openshift-ingress

deployment-controller

e2e-ipp-cleanup-a585ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

openshift-ingress

multus

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-a585ca-8b466745d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca: serviceaccount "payload-processing-e2e-ipp-cleanup-a585ca" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-a585ca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-a585ca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-a585ca-8b466745d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-a585ca-8b466745d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca: serviceaccount "payload-processing-e2e-ipp-cleanup-a585ca" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-cleanup-a585ca

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-cleanup-a585ca": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9960e7fd-074e-41fb-91bf-e61a0ffe15ae, UID in object meta:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-cleanup-a585ca-openshift-default-74dd9dfff8-rgnvv

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-e22c40-openshift-default-5cb96bb486-jr79w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-d66e66-openshift-default-6f77476bbb-kmhwj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-299af2-865774ff5d-x572k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-299af2-openshift-default-7fd54df7b8-wbrtm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-ab0ae6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-ab0ae6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6ffce1a4-c6f4-4ff1-88de-8205cb63c704, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-ab0ae6-579745dff8-6sk7d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-ab0ae6-openshift-default-59fc8c788-trs29

Killing

Stopping container istio-proxy