Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-687dbb6cf6-sbnj2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2 to ip-10-0-138-196.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-6czx5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6czx5 to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5 to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d-r27zs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d-r27zs to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb-82lbv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb-82lbv to ip-10-0-134-46.ec2.internal

openshift-ingress

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6427fe-694957c58d-6mdq2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6427fe-694957c58d-6mdq2 to ip-10-0-134-46.ec2.internal

openshift-ingress

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5 to ip-10-0-138-196.ec2.internal

openshift-ingress

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8 to ip-10-0-138-196.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-hjd5c

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hjd5c to ip-10-0-134-46.ec2.internal

openshift-ingress

kube-auth-proxy-746fd96bc4-5s4vp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-746fd96bc4-5s4vp to ip-10-0-131-14.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-b0e02a-6df478f744-p9lj9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b0e02a-6df478f744-p9lj9 to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-625864-bcd6fbccb-lm272

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-625864-bcd6fbccb-lm272 to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0d1b0907-58fb984b98-swzvs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0d1b0907-58fb984b98-swzvs to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8-9zt6t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8-9zt6t to ip-10-0-131-14.ec2.internal

openshift-ingress

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl to ip-10-0-138-196.ec2.internal

openshift-ingress

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696-mjzpb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696-mjzpb to ip-10-0-131-14.ec2.internal

openshift-ingress

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c to ip-10-0-138-196.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-s85mq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq to ip-10-0-138-196.ec2.internal

openshift-ingress

e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-slqn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-slqn2 to ip-10-0-134-46.ec2.internal

openshift-ingress

kube-auth-proxy-746fd96bc4-btn27

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-746fd96bc4-btn27 to ip-10-0-134-46.ec2.internal

openshift-ingress

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p to ip-10-0-138-196.ec2.internal

openshift-ingress

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx to ip-10-0-138-196.ec2.internal

openshift-ingress

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cc16b618-58b76d755b-snt86

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cc16b618-58b76d755b-snt86 to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-83d598-bdbb878fb-24qtg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-83d598-bdbb878fb-24qtg to ip-10-0-134-46.ec2.internal

openshift-ingress

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

Scheduled

Successfully assigned openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs to ip-10-0-138-196.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ed4837-cc989956b-x9whb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ed4837-cc989956b-x9whb to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-594b65-cdd8786c8-wkgpb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-594b65-cdd8786c8-wkgpb to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6427fe-7d47786954-9hszc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6427fe-7d47786954-9hszc to ip-10-0-131-14.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a3125a-7659868978-b6vgm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a3125a-7659868978-b6vgm to ip-10-0-131-14.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74-hgdj2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74-hgdj2 to ip-10-0-131-14.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-d993b9ed-b76959db5-xxgm9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d993b9ed-b76959db5-xxgm9 to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9759ef96-687746f584-5tclw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9759ef96-687746f584-5tclw to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw to ip-10-0-138-196.ec2.internal

openshift-ingress

router-default-8cf7bccb4-x647z

Scheduled

Successfully assigned openshift-ingress/router-default-8cf7bccb4-x647z to ip-10-0-131-14.ec2.internal

openshift-ingress

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9 to ip-10-0-138-196.ec2.internal

openshift-ingress

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-ba69fc-65956d55db-4hptz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-ba69fc-65956d55db-4hptz to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cc16b618-759cfd857d-tfbcv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cc16b618-759cfd857d-tfbcv to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-processing-e2e-mt-75d3fbe4-76db557c8-vqfvx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-75d3fbe4-76db557c8-vqfvx to ip-10-0-134-46.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-crrck

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-crrck to ip-10-0-134-46.ec2.internal

openshift-ingress

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c to ip-10-0-138-196.ec2.internal

openshift-ingress

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv to ip-10-0-138-196.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-5l5nm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5l5nm to ip-10-0-134-46.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-8cf7bccb4 from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-8cf7bccb4

FailedCreate

Error creating: pods "router-default-8cf7bccb4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-8cf7bccb4

FailedCreate

Error creating: pods "router-default-8cf7bccb4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-8cf7bccb4

SuccessfulCreate

Created pod: router-default-8cf7bccb4-x647z
(x6)

openshift-ingress

kubelet

router-default-8cf7bccb4-x647z

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-8cf7bccb4-x647z

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-8cf7bccb4-x647z

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-8cf7bccb4-x647z

Started

Started container router

openshift-ingress

kubelet

router-default-8cf7bccb4-x647z

Created

Created container: router

openshift-ingress

kubelet

router-default-8cf7bccb4-x647z

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:627e54de31981702dfc5986fda8e14dd7490cc3ccfa94709d1b412defbb073bf" already present on machine
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-746fd96bc4

FailedCreate

Error creating: pods "kube-auth-proxy-746fd96bc4-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-746fd96bc4 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-5s4vp

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-btn27

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-746fd96bc4

SuccessfulCreate

Created pod: kube-auth-proxy-746fd96bc4-5s4vp

openshift-ingress

replicaset-controller

kube-auth-proxy-746fd96bc4

SuccessfulCreate

Created pod: kube-auth-proxy-746fd96bc4-btn27

openshift-ingress

multus

kube-auth-proxy-746fd96bc4-btn27

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-5l5nm

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-5s4vp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-746fd96bc4-5s4vp

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-btn27

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-5l5nm

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-5l5nm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-5s4vp

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-5s4vp

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-5s4vp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.424s (3.424s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-5l5nm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.592s (5.592s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-btn27

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 6.167s (6.167s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-5l5nm

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-5l5nm

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-btn27

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-746fd96bc4-btn27

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-5l5nm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-s85mq

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-5l5nm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-hjd5c

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-s85mq

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s85mq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-hjd5c

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hjd5c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s85mq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s85mq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s85mq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.494s (2.494s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-5l5nm

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-5l5nm

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hjd5c

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hjd5c

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hjd5c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.983s (2.983s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-6czx5

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-6czx5

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-crrck
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-sbnj2

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-sbnj2

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5cc6cd444b-crrck

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-crrck

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-sbnj2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-sbnj2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.46s (1.46s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-sbnj2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-sbnj2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-crrck

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-crrck

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-crrck

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.195s (2.195s including waiting). Image size: 165907127 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6czx5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6czx5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6czx5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6czx5

Unhealthy

Startup probe failed: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6czx5

ProbeError

Startup probe error: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-b570cb7c-openshift-default-79c8d5fb66

SuccessfulCreate

Created pod: e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

openshift-ingress

gateway_labeler_controller

e2e-ait-b570cb7c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b570cb7c

openshift-ingress

deployment-controller

e2e-ait-b570cb7c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b570cb7c-openshift-default-79c8d5fb66 from 0 to 1

openshift-ingress

multus

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b570cb7c-744fc5c4c4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b570cb7c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b570cb7c-744fc5c4c4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b570cb7c-744fc5c4c4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b570cb7c-744fc5c4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b570cb7c: serviceaccount "payload-processing-e2e-ait-b570cb7c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b570cb7c: serviceaccount "payload-processing-e2e-ait-b570cb7c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b570cb7c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": read tcp 10.132.0.2:55070->10.132.0.45:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": read tcp 10.132.0.2:55070->10.132.0.45:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-d993b9ed-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-d993b9ed-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d993b9ed-gw

openshift-ingress

replicaset-controller

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d

SuccessfulCreate

Created pod: e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-b570cb7c-openshift-default-79c8d5fb66-bnbtn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.827s (4.827s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d993b9ed-b76959db5

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d993b9ed-b76959db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d993b9ed: serviceaccount "payload-processing-e2e-migrate-d993b9ed" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d993b9ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d993b9ed-b76959db5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d993b9ed-b76959db5

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d993b9ed-b76959db5-xxgm9

openshift-ingress

kubelet

payload-processing-e2e-migrate-d993b9ed-b76959db5-xxgm9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d993b9ed-b76959db5-xxgm9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d993b9ed-b76959db5-xxgm9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-d993b9ed-b76959db5-xxgm9

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d993b9ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d993b9ed: serviceaccount "payload-processing-e2e-migrate-d993b9ed" not found
(x2)

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-9759ef96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9759ef96

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-d993b9ed

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-d993b9ed": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 64aa4da3-6f44-4504-9fb4-8532e78db585, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-d993b9ed-b76959db5-xxgm9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-ait-9759ef96

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-9759ef96-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-9759ef96-authn-ssl" already exists

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-9759ef96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9759ef96-openshift-default-6b85696db4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-9759ef96-openshift-default-6b85696db4

SuccessfulCreate

Created pod: e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

openshift-ingress

multus

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9759ef96-687746f584

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9759ef96-687746f584-5tclw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9759ef96-5679f69d4d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9759ef96: serviceaccount "payload-processing-e2e-ait-9759ef96" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9759ef96-687746f584

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9759ef96-687746f584-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9759ef96: serviceaccount "payload-processing-e2e-ait-9759ef96" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9759ef96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9759ef96-687746f584 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9759ef96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9759ef96-5679f69d4d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9759ef96-5679f69d4d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-9759ef96-687746f584-5tclw

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9759ef96-687746f584-5tclw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9759ef96-687746f584-5tclw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9759ef96-687746f584-5tclw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-9759ef96-687746f584-5tclw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-0d1b0907

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0d1b0907

openshift-ingress

multus

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96

SuccessfulCreate

Created pod: e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

openshift-ingress

deployment-controller

e2e-derive-0d1b0907-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0d1b0907-openshift-default-7ddc5fbb96 from 0 to 1

openshift-ingress

kubelet

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-9759ef96-openshift-default-6b85696db4-44pnp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0d1b0907

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0d1b0907-58fb984b98 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-0d1b0907-58fb984b98-swzvs

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0d1b0907: serviceaccount "payload-processing-e2e-derive-0d1b0907" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0d1b0907-58fb984b98

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0d1b0907-58fb984b98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0d1b0907: serviceaccount "payload-processing-e2e-derive-0d1b0907" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0d1b0907-58fb984b98

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0d1b0907-58fb984b98-swzvs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0d1b0907

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0d1b0907-58fb984b98-swzvs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0d1b0907-58fb984b98-swzvs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0d1b0907-58fb984b98-swzvs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp

Unhealthy

Readiness probe failed: dial tcp 10.134.0.53:9004: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-0d1b0907-58fb984b98-swzvs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-cc16b618

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cc16b618

openshift-ingress

replicaset-controller

e2e-mt-cc16b618-openshift-default-568dd47fb4

SuccessfulCreate

Created pod: e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

openshift-ingress

deployment-controller

e2e-mt-cc16b618-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cc16b618-openshift-default-568dd47fb4 from 0 to 1

openshift-ingress

multus

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cc16b618-58b76d755b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cc16b618-58b76d755b-snt86

openshift-ingress

multus

payload-processing-e2e-mt-cc16b618-759cfd857d-tfbcv

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cc16b618-759cfd857d-tfbcv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cc16b618-58b76d755b-snt86

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cc16b618-759cfd857d-tfbcv

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cc16b618

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cc16b618-759cfd857d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cc16b618-759cfd857d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cc16b618-759cfd857d-tfbcv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cc16b618-759cfd857d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cc16b618-759cfd857d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cc16b618: serviceaccount "payload-processing-e2e-mt-cc16b618" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cc16b618

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cc16b618-58b76d755b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cc16b618-58b76d755b-snt86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cc16b618-58b76d755b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cc16b618-58b76d755b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cc16b618: serviceaccount "payload-processing-e2e-mt-cc16b618" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-cc16b618-759cfd857d-tfbcv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-cc16b618-58b76d755b-snt86

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cc16b618-58b76d755b-snt86

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cc16b618-58b76d755b-snt86

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-cc16b618

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-cc16b618: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-cc16b618": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-cc16b618, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0d7bb684-3efb-4508-a89b-3b06df8c9240, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-cc16b618-759cfd857d-tfbcv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b

SuccessfulCreate

Created pod: e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

openshift-ingress

deployment-controller

e2e-mt-75d3fbe4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-75d3fbe4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-75d3fbe4

openshift-ingress

kubelet

payload-processing-e2e-mt-75d3fbe4-76db557c8-vqfvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-slqn2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-slqn2

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-75d3fbe4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-75d3fbe4-76db557c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-75d3fbe4-76db557c8-vqfvx

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-75d3fbe4-76db557c8-vqfvx

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-75d3fbe4-76db557c8-vqfvx

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-75d3fbe4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-75d3fbe4-76db557c8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-75d3fbe4-76db557c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-75d3fbe4: serviceaccount "payload-processing-e2e-mt-75d3fbe4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-75d3fbe4-76db557c8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-75d3fbe4-76db557c8-vqfvx

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-slqn2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-slqn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-75d3fbe4: serviceaccount "payload-processing-e2e-mt-75d3fbe4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-slqn2

openshift-ingress

kubelet

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": read tcp 10.134.0.2:34854->10.134.0.59:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": read tcp 10.134.0.2:34854->10.134.0.59:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-75d3fbe4-76db557c8-vqfvx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-slqn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-75d3fbe4-5f5bd78656-slqn2

Unhealthy

Readiness probe failed: dial tcp 10.132.0.59:9004: i/o timeout

openshift-ingress

kubelet

e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-83d598-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-83d598-openshift-default-554dbfc46d from 0 to 1

openshift-ingress

multus

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-83d598

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-83d598

openshift-ingress

replicaset-controller

e2e-inf-a-83d598-openshift-default-554dbfc46d

SuccessfulCreate

Created pod: e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-83d598

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-83d598-bdbb878fb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-83d598-bdbb878fb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-83d598-bdbb878fb-24qtg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-83d598-bdbb878fb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-83d598-bdbb878fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-83d598: serviceaccount "payload-processing-e2e-inf-a-83d598" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-83d598-bdbb878fb-24qtg

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-83d598-bdbb878fb-24qtg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-83d598

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d-r27zs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-83d598: serviceaccount "payload-processing-e2e-inf-a-83d598" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d-r27zs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d-r27zs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-83d598-bdbb878fb-24qtg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d-r27zs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d-r27zs

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-83d598-bdbb878fb-24qtg

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": read tcp 10.134.0.2:50738->10.134.0.61:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": read tcp 10.134.0.2:50738->10.134.0.61:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-ed4837-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ed4837-openshift-default-5fd75bf854 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-ed4837-openshift-default-5fd75bf854

SuccessfulCreate

Created pod: e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ed4837

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ed4837

openshift-ingress

multus

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb-82lbv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ed4837-cc989956b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ed4837-cc989956b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ed4837: serviceaccount "payload-processing-e2e-inf-b-ed4837" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ed4837-cc989956b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ed4837-cc989956b-x9whb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ed4837

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ed4837-cc989956b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ed4837

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ed4837: serviceaccount "payload-processing-e2e-inf-b-ed4837" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ed4837-cc989956b-x9whb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ed4837-cc989956b-x9whb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb-82lbv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb-82lbv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb-82lbv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb-82lbv

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-ed4837-cc989956b-x9whb

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ed4837-cc989956b-x9whb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-83d598-bdbb878fb-24qtg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-83d598-9c4f8b88d-r27zs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ed4837-cc989956b-x9whb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ed4837-5c4c96b7fb-82lbv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-b0e02a-openshift-default-9945cdcd4

SuccessfulCreate

Created pod: e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

openshift-ingress

gateway_labeler_controller

e2e-api-a-b0e02a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b0e02a

openshift-ingress

deployment-controller

e2e-api-a-b0e02a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b0e02a-openshift-default-9945cdcd4 from 0 to 1

openshift-ingress

multus

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b0e02a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b0e02a-6df478f744 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b0e02a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b0e02a-685d7594b8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b0e02a-685d7594b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b0e02a-6df478f744

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b0e02a-6df478f744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b0e02a: serviceaccount "payload-processing-e2e-api-a-b0e02a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b0e02a-685d7594b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b0e02a: serviceaccount "payload-processing-e2e-api-a-b0e02a" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-b0e02a-6df478f744-p9lj9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b0e02a-6df478f744-p9lj9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b0e02a-6df478f744

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b0e02a-6df478f744-p9lj9

openshift-ingress

multus

payload-processing-e2e-api-a-b0e02a-6df478f744-p9lj9

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-b0e02a-6df478f744-p9lj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-625864-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-625864-openshift-default-65bb79db44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-625864-openshift-default-65bb79db44

SuccessfulCreate

Created pod: e2e-api-b-625864-openshift-default-65bb79db44-c99kv

openshift-ingress

gateway_labeler_controller

e2e-api-b-625864

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-625864

openshift-ingress

multus

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-625864-8686b58fb8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-625864-8686b58fb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-625864: serviceaccount "payload-processing-e2e-api-b-625864" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-625864-8686b58fb8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-625864-bcd6fbccb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-625864-bcd6fbccb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-625864: serviceaccount "payload-processing-e2e-api-b-625864" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-625864-bcd6fbccb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-625864-bcd6fbccb-lm272

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-625864

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-625864-bcd6fbccb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-625864

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-625864-8686b58fb8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-625864-bcd6fbccb-lm272

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-625864-bcd6fbccb-lm272

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-625864-bcd6fbccb-lm272

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-625864-bcd6fbccb-lm272

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f

Unhealthy

Readiness probe failed: dial tcp 10.134.0.67:9004: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f

Unhealthy

Liveness probe failed: dial tcp 10.134.0.67:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b0e02a-6df478f744-p9lj9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-b0e02a-openshift-default-9945cdcd4-plnjb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-625864-bcd6fbccb-lm272

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-625864-openshift-default-65bb79db44-c99kv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-ba69fc-openshift-default-848b94c58d

SuccessfulCreate

Created pod: e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp

openshift-ingress

gateway_labeler_controller

e2e-shared-a-ba69fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-ba69fc

openshift-ingress

deployment-controller

e2e-shared-a-ba69fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-ba69fc-openshift-default-848b94c58d from 0 to 1

openshift-ingress

multus

e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ba69fc-65956d55db-4hptz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-ba69fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-ba69fc: serviceaccount "payload-processing-e2e-shared-a-ba69fc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-ba69fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-ba69fc-65956d55db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-ba69fc-65956d55db

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-ba69fc-65956d55db-4hptz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-ba69fc-65956d55db

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-ba69fc-65956d55db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-ba69fc: serviceaccount "payload-processing-e2e-shared-a-ba69fc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-ba69fc-65956d55db-4hptz

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ba69fc-65956d55db-4hptz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ba69fc-65956d55db-4hptz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b

Unhealthy

Readiness probe failed: dial tcp 10.134.0.70:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-594b65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-594b65

openshift-ingress

deployment-controller

e2e-shared-b-594b65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-594b65-openshift-default-999d44448 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-594b65-openshift-default-999d44448

SuccessfulCreate

Created pod: e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-594b65-5b448b6856

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-594b65-5b448b6856-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-594b65: serviceaccount "payload-processing-e2e-shared-b-594b65" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-594b65-5b448b6856

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-594b65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-594b65-5b448b6856 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-594b65-cdd8786c8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-594b65-cdd8786c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-594b65: serviceaccount "payload-processing-e2e-shared-b-594b65" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-594b65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-594b65-cdd8786c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-594b65-cdd8786c8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-594b65-cdd8786c8-wkgpb

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-594b65-cdd8786c8-wkgpb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-594b65-cdd8786c8-wkgpb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-594b65-cdd8786c8-wkgpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-594b65-cdd8786c8-wkgpb

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6427fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6427fe

openshift-ingress

multus

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-6427fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d

SuccessfulCreate

Created pod: e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6427fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6427fe-694957c58d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6427fe-7d47786954

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6427fe-7d47786954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6427fe: serviceaccount "payload-processing-e2e-ipp-a-6427fe" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6427fe-694957c58d-6mdq2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6427fe-694957c58d-6mdq2

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6427fe-694957c58d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6427fe-694957c58d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6427fe: serviceaccount "payload-processing-e2e-ipp-a-6427fe" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-6427fe-7d47786954-9hszc

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6427fe-7d47786954-9hszc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6427fe-694957c58d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6427fe-694957c58d-6mdq2

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6427fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6427fe-7d47786954 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6427fe-7d47786954

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6427fe-7d47786954-9hszc

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6427fe-694957c58d-6mdq2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6427fe-694957c58d-6mdq2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6427fe-7d47786954-9hszc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6427fe-7d47786954-9hszc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6427fe-7d47786954-9hszc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.658s (1.658s including waiting). Image size: 165907127 bytes.
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": read tcp 10.134.0.2:50254->10.134.0.76:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": read tcp 10.134.0.2:50254->10.134.0.76:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a3125a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a3125a

openshift-ingress

deployment-controller

e2e-ipp-b-a3125a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a3125a-openshift-default-d559579d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a3125a-openshift-default-d559579d

SuccessfulCreate

Created pod: e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

openshift-ingress

multus

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a3125a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a3125a-7659868978 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a3125a-7659868978

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a3125a-7659868978-b6vgm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a3125a-7659868978

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a3125a-7659868978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a3125a: serviceaccount "payload-processing-e2e-ipp-b-a3125a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a3125a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8-9zt6t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a3125a: serviceaccount "payload-processing-e2e-ipp-b-a3125a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8-9zt6t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8-9zt6t

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a3125a-7659868978-b6vgm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a3125a-7659868978-b6vgm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-a3125a-7659868978-b6vgm

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8-9zt6t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8-9zt6t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a3125a-7659868978-b6vgm

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4

SuccessfulCreate

Created pod: e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

openshift-ingress

deployment-controller

e2e-ipp-cleanup-2696ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-2696ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-2696ea

openshift-ingress

multus

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696-mjzpb

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2696ea: serviceaccount "payload-processing-e2e-ipp-cleanup-2696ea" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74-hgdj2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74-hgdj2

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74-hgdj2

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74-hgdj2

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-2696ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696-mjzpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696-mjzpb

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74-hgdj2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696-mjzpb

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2696ea: serviceaccount "payload-processing-e2e-ipp-cleanup-2696ea" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696-mjzpb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-2696ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2696ea-847dcd5b74-hgdj2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2696ea-f5999b696-mjzpb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6427fe-7d47786954-9hszc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6427fe-694957c58d-6mdq2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a3125a-74686fbdb8-9zt6t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a3125a-7659868978-b6vgm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ba69fc-65956d55db-4hptz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-ba69fc-openshift-default-848b94c58d-v8kxp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-594b65-cdd8786c8-wkgpb

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-594b65

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-594b65: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-594b65": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-594b65, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 40fc71bc-a762-460a-8c53-f978a97e8f63, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm

Unhealthy

Readiness probe failed: dial tcp 10.134.0.72:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-b-594b65-openshift-default-999d44448-l7dbh

Killing

Stopping container istio-proxy