Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-a-w2-72cb16-b9f649dc-hg725

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-72cb16-b9f649dc-hg725 to ip-10-0-139-139.ec2.internal

openshift-ingress

e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5 to ip-10-0-133-153.ec2.internal

openshift-ingress

e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z to ip-10-0-133-153.ec2.internal

openshift-ingress

kube-auth-proxy-5586db6db5-wpksw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5586db6db5-wpksw to ip-10-0-130-119.ec2.internal

openshift-ingress

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n to ip-10-0-133-153.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-cqglj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cqglj to ip-10-0-133-153.ec2.internal

openshift-ingress

e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz to ip-10-0-139-139.ec2.internal

openshift-ingress

kube-auth-proxy-5586db6db5-hp98n

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5586db6db5-hp98n to ip-10-0-133-153.ec2.internal

openshift-ingress

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-636b04-c87d67c94-h9plg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-636b04-c87d67c94-h9plg to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-processing-e2e-derive-02ec029f-7c98987685-qjlxd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-02ec029f-7c98987685-qjlxd to ip-10-0-130-119.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2eb161-74458547d9-lp42r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2eb161-74458547d9-lp42r to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-processing-e2e-autores-55111c-bc5896cc-cj2lg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-55111c-bc5896cc-cj2lg to ip-10-0-139-139.ec2.internal

openshift-ingress

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5 to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b83cfe-799569dfff-fbhds

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b83cfe-799569dfff-fbhds to ip-10-0-130-119.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-866a8b-664d66cbc7-nsc4j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-866a8b-664d66cbc7-nsc4j to ip-10-0-139-139.ec2.internal

openshift-ingress

e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4

Scheduled

Successfully assigned openshift-ingress/e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4 to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb-c9zvz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb-c9zvz to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986-zfw9r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986-zfw9r to ip-10-0-130-119.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-02ec029f-6944458bcd-8s6fw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-02ec029f-6944458bcd-8s6fw to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e0690faf-7746444d77-gpnv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e0690faf-7746444d77-gpnv5 to ip-10-0-130-119.ec2.internal

openshift-ingress

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-ccf833-745684f765-gm48l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-ccf833-745684f765-gm48l to ip-10-0-139-139.ec2.internal

openshift-ingress

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4 to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-e2e-ait-2b45b43b-745d8b5779-zr2nx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2b45b43b-745d8b5779-zr2nx to ip-10-0-130-119.ec2.internal

openshift-ingress

e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q

Scheduled

Successfully assigned openshift-ingress/e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q to ip-10-0-133-153.ec2.internal

openshift-ingress

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-jdfbt

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-jdfbt to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78-mr7w2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78-mr7w2 to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-55111c-d7b6f9fdb-m5487

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-55111c-d7b6f9fdb-m5487 to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6-smqls

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6-smqls to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6-682n2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6-682n2 to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d-9mnlv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d-9mnlv to ip-10-0-139-139.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-llhlk

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-llhlk to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b-xsr94

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b-xsr94 to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46-7jthw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46-7jthw to ip-10-0-130-119.ec2.internal

openshift-ingress

e2e-api-a-866a8b-openshift-default-585855d566-lpffv

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-866a8b-openshift-default-585855d566-lpffv to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2313d276-868b8bbc45-hf2hb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2313d276-868b8bbc45-hf2hb to ip-10-0-139-139.ec2.internal

openshift-ingress

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-2dae43f5-668bfc8f8-v2nkx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-2dae43f5-668bfc8f8-v2nkx to ip-10-0-130-119.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67-6qtzw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67-6qtzw to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5-g7s6x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5-g7s6x to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-b4xt6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-b4xt6 to ip-10-0-130-119.ec2.internal

openshift-ingress

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-69ef21-bfff87f47-jf6rh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-69ef21-bfff87f47-jf6rh to ip-10-0-130-119.ec2.internal

openshift-ingress

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22 to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4-8dk46

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4-8dk46 to ip-10-0-139-139.ec2.internal

openshift-ingress

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4 to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e0690faf-6887984d7d-bjtzc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e0690faf-6887984d7d-bjtzc to ip-10-0-139-139.ec2.internal

openshift-ingress

e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f

Scheduled

Successfully assigned openshift-ingress/e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f to ip-10-0-133-153.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6qzwg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6qzwg to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-636b04-dbf4b9ff7-rjbxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-636b04-dbf4b9ff7-rjbxc to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-fbf820-546fc575cf-gmts2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-fbf820-546fc575cf-gmts2 to ip-10-0-139-139.ec2.internal

openshift-ingress

router-default-78f4854998-kj5tp

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5-78dkv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5-78dkv to ip-10-0-139-139.ec2.internal

openshift-ingress

router-default-78f4854998-kj5tp

Scheduled

Successfully assigned openshift-ingress/router-default-78f4854998-kj5tp to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-232aeb-6fd4cccb55-p8qfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-232aeb-6fd4cccb55-p8qfr to ip-10-0-139-139.ec2.internal

openshift-ingress

e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-processing-e2e-mt-aec3c2bf-7f7947f7c7-thkmk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-aec3c2bf-7f7947f7c7-thkmk to ip-10-0-139-139.ec2.internal

openshift-ingress

e2e-autores-55111c-openshift-default-84675d875d-f58sc

Scheduled

Successfully assigned openshift-ingress/e2e-autores-55111c-openshift-default-84675d875d-f58sc to ip-10-0-133-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4-t8xf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4-t8xf9 to ip-10-0-130-119.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-2dae43f5-66d774666-d8gk5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-2dae43f5-66d774666-d8gk5 to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d-qtxkg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d-qtxkg to ip-10-0-139-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2313d276-595c6754c8-gjsgh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2313d276-595c6754c8-gjsgh to ip-10-0-130-119.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8-sfxb9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8-sfxb9 to ip-10-0-130-119.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6-cktg5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6-cktg5 to ip-10-0-130-119.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-m7ftd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-m7ftd to ip-10-0-139-139.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-78f4854998 from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-78f4854998

FailedCreate

Error creating: pods "router-default-78f4854998-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-78f4854998

FailedCreate

Error creating: pods "router-default-78f4854998-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-78f4854998

SuccessfulCreate

Created pod: router-default-78f4854998-kj5tp
(x6)

openshift-ingress

kubelet

router-default-78f4854998-kj5tp

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-78f4854998-kj5tp

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-78f4854998-kj5tp

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-78f4854998-kj5tp

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-78f4854998-kj5tp

Created

Created container: router

openshift-ingress

kubelet

router-default-78f4854998-kj5tp

Started

Started container router
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5586db6db5

FailedCreate

Error creating: pods "kube-auth-proxy-5586db6db5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5586db6db5 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5586db6db5

SuccessfulCreate

Created pod: kube-auth-proxy-5586db6db5-hp98n

openshift-ingress

replicaset-controller

kube-auth-proxy-5586db6db5

SuccessfulCreate

Created pod: kube-auth-proxy-5586db6db5-wpksw

openshift-ingress

kubelet

kube-auth-proxy-5586db6db5-hp98n

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5586db6db5-wpksw

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5586db6db5-wpksw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5586db6db5-hp98n

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6qzwg

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6qzwg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6qzwg

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5586db6db5-wpksw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.705s (2.705s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5586db6db5-hp98n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.797s (2.797s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5586db6db5-wpksw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5586db6db5-wpksw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5586db6db5-hp98n

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5586db6db5-hp98n

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6qzwg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6qzwg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.315s (3.315s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6qzwg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6qzwg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6qzwg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-llhlk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-llhlk

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-llhlk

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-llhlk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.281s (5.281s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-llhlk

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-llhlk

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-m7ftd

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-m7ftd

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m7ftd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m7ftd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.265s (2.265s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m7ftd

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m7ftd

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m7ftd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m7ftd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6qzwg

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6qzwg

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-cqglj

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-cqglj

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqglj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqglj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.474s (2.474s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-b4xt6

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-jdfbt

openshift-ingress

multus

payload-processing-5b54b7fbb7-jdfbt

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-b4xt6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-jdfbt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-b4xt6

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-jdfbt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-b4xt6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-b4xt6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-b4xt6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.567s (1.567s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-jdfbt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-jdfbt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.606s (1.606s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqglj

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqglj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqglj

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqglj

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqglj

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-232aeb-openshift-default-6d9ffcb9b

SuccessfulCreate

Created pod: e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz

openshift-ingress

multus

e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-232aeb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-232aeb

openshift-ingress

deployment-controller

e2e-inf-a-232aeb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-232aeb-openshift-default-6d9ffcb9b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-232aeb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-232aeb-6fd4cccb55 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-232aeb: serviceaccount "payload-processing-e2e-inf-a-232aeb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-232aeb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-232aeb-6fd4cccb55

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-232aeb-6fd4cccb55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-232aeb: serviceaccount "payload-processing-e2e-inf-a-232aeb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb-c9zvz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-232aeb-6fd4cccb55-p8qfr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb-c9zvz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-232aeb-6fd4cccb55-p8qfr

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-232aeb-6fd4cccb55

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-232aeb-6fd4cccb55-p8qfr

openshift-ingress

multus

payload-processing-e2e-inf-a-232aeb-6fd4cccb55-p8qfr

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-232aeb-6fd4cccb55-p8qfr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb-c9zvz

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb-c9zvz

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb-c9zvz

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-e0690faf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e0690faf

openshift-ingress

multus

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-e0690faf-openshift-default-6c7fc99f4b

SuccessfulCreate

Created pod: e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

openshift-ingress

deployment-controller

e2e-ait-e0690faf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e0690faf-openshift-default-6c7fc99f4b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-55111c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-55111c

openshift-ingress

deployment-controller

e2e-autores-55111c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-55111c-openshift-default-84675d875d from 0 to 1

openshift-ingress

multus

e2e-autores-55111c-openshift-default-84675d875d-f58sc

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-55111c-openshift-default-84675d875d

SuccessfulCreate

Created pod: e2e-autores-55111c-openshift-default-84675d875d-f58sc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e0690faf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e0690faf-6887984d7d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e0690faf-6887984d7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e0690faf-6887984d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e0690faf: serviceaccount "payload-processing-e2e-ait-e0690faf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e0690faf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e0690faf-7746444d77 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e0690faf-7746444d77

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e0690faf-7746444d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e0690faf: serviceaccount "payload-processing-e2e-ait-e0690faf" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-e0690faf-7746444d77-gpnv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e0690faf-6887984d7d-bjtzc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-e0690faf-6887984d7d-bjtzc

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e0690faf-6887984d7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e0690faf-6887984d7d-bjtzc

openshift-ingress

multus

payload-processing-e2e-ait-e0690faf-7746444d77-gpnv5

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e0690faf-6887984d7d-bjtzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e0690faf-7746444d77-gpnv5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e0690faf-7746444d77-gpnv5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e0690faf-6887984d7d-bjtzc

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e0690faf-7746444d77

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e0690faf-7746444d77-gpnv5

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-55111c-bc5896cc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-55111c-bc5896cc-cj2lg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-55111c-d7b6f9fdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-55111c-d7b6f9fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-55111c: serviceaccount "payload-processing-e2e-autores-55111c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-55111c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-55111c-bc5896cc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-55111c-d7b6f9fdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-55111c-d7b6f9fdb-m5487

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-55111c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-55111c-d7b6f9fdb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-55111c-bc5896cc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-55111c-bc5896cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-55111c: serviceaccount "payload-processing-e2e-autores-55111c" not found

openshift-ingress

multus

payload-processing-e2e-autores-55111c-bc5896cc-cj2lg

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-55111c-bc5896cc-cj2lg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-55111c-bc5896cc-cj2lg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-55111c-bc5896cc-cj2lg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-55111c-d7b6f9fdb-m5487

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-55111c-d7b6f9fdb-m5487

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-55111c-d7b6f9fdb-m5487

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-55111c-d7b6f9fdb-m5487

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-636b04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-636b04-openshift-default-85cd759bc4 from 0 to 1

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-inf-b-636b04-openshift-default-85cd759bc4

SuccessfulCreate

Created pod: e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z

openshift-ingress

gateway_labeler_controller

e2e-inf-b-636b04

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-636b04
(x2)

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-636b04-c87d67c94-h9plg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-636b04-dbf4b9ff7-rjbxc

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-636b04-dbf4b9ff7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-636b04-dbf4b9ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-636b04: serviceaccount "payload-processing-e2e-inf-b-636b04" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-636b04-dbf4b9ff7-rjbxc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-636b04-c87d67c94-h9plg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-636b04-c87d67c94-h9plg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-636b04-c87d67c94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-636b04-c87d67c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-636b04: serviceaccount "payload-processing-e2e-inf-b-636b04" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-636b04-dbf4b9ff7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-636b04-dbf4b9ff7-rjbxc

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-636b04-c87d67c94-h9plg

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-636b04-dbf4b9ff7-rjbxc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-636b04-c87d67c94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-636b04-c87d67c94-h9plg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-636b04

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-636b04-c87d67c94 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-636b04

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-636b04-dbf4b9ff7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-636b04-dbf4b9ff7-rjbxc

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e0690faf-6887984d7d-bjtzc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e0690faf-7746444d77-gpnv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-e0690faf-openshift-default-6c7fc99f4b-5vhg4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-migrate-2dae43f5-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-2dae43f5-gw

openshift-ingress

deployment-controller

e2e-migrate-2dae43f5-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-2dae43f5-gw-openshift-default-8479886f76 from 0 to 1

openshift-ingress

multus

e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-2dae43f5-gw-openshift-default-8479886f76

SuccessfulCreate

Created pod: e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh
(x5)

openshift-ingress

kubelet

e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2dae43f5-668bfc8f8

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-2dae43f5-668bfc8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2dae43f5: serviceaccount "payload-processing-e2e-migrate-2dae43f5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-2dae43f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-2dae43f5-668bfc8f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2dae43f5-66d774666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-2dae43f5-66d774666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2dae43f5: serviceaccount "payload-processing-e2e-migrate-2dae43f5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-2dae43f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-2dae43f5-66d774666 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2dae43f5-66d774666-d8gk5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2dae43f5-668bfc8f8

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-2dae43f5-668bfc8f8-v2nkx

openshift-ingress

kubelet

payload-processing-e2e-migrate-2dae43f5-668bfc8f8-v2nkx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2dae43f5-668bfc8f8-v2nkx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2dae43f5-668bfc8f8-v2nkx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-2dae43f5-668bfc8f8-v2nkx

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2dae43f5-66d774666-d8gk5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2dae43f5-66d774666-d8gk5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2dae43f5-66d774666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-2dae43f5-66d774666-d8gk5

openshift-ingress

multus

payload-pre-processing-e2e-migrate-2dae43f5-66d774666-d8gk5

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2dae43f5-66d774666-d8gk5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-2dae43f5-gw-openshift-default-8479886f76-k46dh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-2dae43f5-668bfc8f8-v2nkx

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-2b45b43b-openshift-default-64775f4bd8

SuccessfulCreate

Created pod: e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

openshift-ingress

deployment-controller

e2e-ait-2b45b43b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2b45b43b-openshift-default-64775f4bd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-2b45b43b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2b45b43b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b45b43b-745d8b5779

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2b45b43b-745d8b5779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b45b43b: serviceaccount "payload-processing-e2e-ait-2b45b43b" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b45b43b: serviceaccount "payload-processing-e2e-ait-2b45b43b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2b45b43b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2b45b43b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2b45b43b-745d8b5779 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4-8dk46

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-2b45b43b-745d8b5779-zr2nx

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4-8dk46

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2b45b43b-745d8b5779-zr2nx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4-8dk46

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4-8dk46

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4-8dk46

openshift-ingress

kubelet

payload-processing-e2e-ait-2b45b43b-745d8b5779-zr2nx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2b45b43b-745d8b5779-zr2nx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b45b43b-745d8b5779

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2b45b43b-745d8b5779-zr2nx

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:53368->10.132.0.51:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:53368->10.132.0.51:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b45b43b-79b4cdf4-8dk46

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2b45b43b-745d8b5779-zr2nx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-02ec029f-openshift-default-545d7b5b56

SuccessfulCreate

Created pod: e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f

openshift-ingress

multus

e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-02ec029f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-02ec029f-openshift-default-545d7b5b56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-02ec029f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-02ec029f

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-2b45b43b-openshift-default-64775f4bd8-cm4zt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-02ec029f-6944458bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-02ec029f-6944458bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-02ec029f: serviceaccount "payload-processing-e2e-derive-02ec029f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-02ec029f-6944458bcd-8s6fw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-derive-02ec029f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-02ec029f-7c98987685 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-02ec029f-7c98987685

SuccessfulCreate

Created pod: payload-processing-e2e-derive-02ec029f-7c98987685-qjlxd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-02ec029f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-02ec029f-6944458bcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-02ec029f-7c98987685

FailedCreate

Error creating: pods "payload-processing-e2e-derive-02ec029f-7c98987685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-02ec029f: serviceaccount "payload-processing-e2e-derive-02ec029f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-02ec029f-6944458bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-02ec029f-6944458bcd-8s6fw

openshift-ingress

multus

payload-processing-e2e-derive-02ec029f-7c98987685-qjlxd

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-02ec029f-6944458bcd-8s6fw

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-02ec029f-7c98987685-qjlxd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-02ec029f-7c98987685-qjlxd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-02ec029f-6944458bcd-8s6fw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-02ec029f-6944458bcd-8s6fw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-02ec029f-7c98987685-qjlxd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-55111c-d7b6f9fdb-m5487

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-55111c-bc5896cc-cj2lg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-02ec029f-openshift-default-545d7b5b56-p482f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-02ec029f-6944458bcd-8s6fw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-02ec029f-7c98987685-qjlxd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-ccf833

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-ccf833

openshift-ingress

replicaset-controller

e2e-explicit-ccf833-openshift-default-ff8cb7d7b

SuccessfulCreate

Created pod: e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

openshift-ingress

multus

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-ccf833-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-ccf833-openshift-default-ff8cb7d7b from 0 to 1

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-55111c-openshift-default-84675d875d-f58sc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-ccf833

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-ccf833-745684f765 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986-zfw9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986-zfw9r

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986-zfw9r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-ccf833

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-ccf833-745684f765-gm48l

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-ccf833-745684f765-gm48l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ccf833-745684f765-gm48l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-ccf833-745684f765-gm48l

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986-zfw9r

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ccf833-745684f765

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-ccf833-745684f765-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ccf833: serviceaccount "payload-processing-e2e-explicit-ccf833" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ccf833: serviceaccount "payload-processing-e2e-explicit-ccf833" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ccf833-745684f765

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-ccf833-745684f765-gm48l

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986-zfw9r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ccf833-7c9c6cf986-zfw9r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ccf833-745684f765-gm48l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-ccf833-openshift-default-ff8cb7d7b-88xvx

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-77b0cb-openshift-default-77b4bb4758

SuccessfulCreate

Created pod: e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4

openshift-ingress

gateway_labeler_controller

e2e-noten-77b0cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-77b0cb

openshift-ingress

deployment-controller

e2e-noten-77b0cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-77b0cb-openshift-default-77b4bb4758 from 0 to 1

openshift-ingress

kubelet

e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-noten-77b0cb-openshift-default-77b4bb4758-6qlv4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-2313d276-openshift-default-77b87b556d

SuccessfulCreate

Created pod: e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

openshift-ingress

gateway_labeler_controller

e2e-mt-2313d276

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2313d276

openshift-ingress

deployment-controller

e2e-mt-2313d276-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2313d276-openshift-default-77b87b556d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2313d276-595c6754c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2313d276-595c6754c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2313d276: serviceaccount "payload-processing-e2e-mt-2313d276" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2313d276-595c6754c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2313d276-595c6754c8-gjsgh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2313d276

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2313d276-595c6754c8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2313d276

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2313d276-868b8bbc45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2313d276-868b8bbc45

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2313d276-868b8bbc45-hf2hb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2313d276-868b8bbc45

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2313d276-868b8bbc45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2313d276: serviceaccount "payload-processing-e2e-mt-2313d276" not found

openshift-ingress

multus

payload-processing-e2e-mt-2313d276-868b8bbc45-hf2hb

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2313d276-868b8bbc45-hf2hb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2313d276-868b8bbc45-hf2hb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2313d276-868b8bbc45-hf2hb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2313d276-595c6754c8-gjsgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2313d276-595c6754c8-gjsgh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2313d276-595c6754c8-gjsgh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-2313d276-595c6754c8-gjsgh

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-232aeb-6fd4cccb55-p8qfr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-232aeb-7c6744dcdb-c9zvz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-232aeb-openshift-default-6d9ffcb9b-b8qfz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-636b04

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-636b04: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-636b04": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-636b04, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6da4e6b6-c7ed-4883-b453-0357268fae6d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-636b04-dbf4b9ff7-rjbxc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-636b04-c87d67c94-h9plg

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2eb161

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2eb161

openshift-ingress

deployment-controller

e2e-shared-a-w3-2eb161-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6

SuccessfulCreate

Created pod: e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

openshift-ingress

kubelet

e2e-inf-b-636b04-openshift-default-85cd759bc4-9652z

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46-7jthw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2eb161-74458547d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2eb161-74458547d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2eb161: serviceaccount "payload-processing-e2e-shared-a-w3-2eb161" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2eb161

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2eb161-74458547d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2eb161-74458547d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2eb161-74458547d9-lp42r
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2eb161: serviceaccount "payload-processing-e2e-shared-a-w3-2eb161" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2eb161

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46-7jthw

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2eb161-74458547d9-lp42r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2eb161-74458547d9-lp42r

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2eb161-74458547d9-lp42r

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2eb161-74458547d9-lp42r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46-7jthw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46-7jthw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46-7jthw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2313d276-595c6754c8-gjsgh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2313d276-868b8bbc45-hf2hb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-2313d276-openshift-default-77b87b556d-tsh7k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd

SuccessfulCreate

Created pod: e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-eb4b45

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-eb4b45

openshift-ingress

deployment-controller

e2e-shared-b-w3-eb4b45-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-72cb16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-72cb16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-72cb16
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-eb4b45: serviceaccount "payload-processing-e2e-shared-b-w3-eb4b45" not found

openshift-ingress

replicaset-controller

e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d

SuccessfulCreate

Created pod: e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-eb4b45

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-eb4b45: serviceaccount "payload-processing-e2e-shared-b-w3-eb4b45" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-eb4b45

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78-mr7w2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78-mr7w2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5-78dkv

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78-mr7w2

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5-78dkv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5-78dkv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5-78dkv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78-mr7w2

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5-78dkv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78-mr7w2

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72cb16-b9f649dc-hg725

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-72cb16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4-t8xf9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4-t8xf9

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-72cb16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-72cb16-b9f649dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-72cb16: serviceaccount "payload-processing-e2e-shared-a-w2-72cb16" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4-t8xf9

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4-t8xf9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-72cb16-b9f649dc-hg725

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4-t8xf9

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-72cb16-b9f649dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-72cb16-b9f649dc-hg725
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-72cb16-b9f649dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-72cb16-b9f649dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-72cb16: serviceaccount "payload-processing-e2e-shared-a-w2-72cb16" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72cb16-b9f649dc-hg725

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72cb16-b9f649dc-hg725

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:34594->10.132.0.64:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:34594->10.132.0.64:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-fbf820

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-fbf820

openshift-ingress

replicaset-controller

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b

SuccessfulCreate

Created pod: e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

openshift-ingress

deployment-controller

e2e-shared-b-w2-fbf820-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-fbf820

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-fbf820-546fc575cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b-xsr94

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b-xsr94
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-fbf820: serviceaccount "payload-processing-e2e-shared-b-w2-fbf820" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-fbf820-546fc575cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-fbf820-546fc575cf-gmts2

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fbf820-546fc575cf-gmts2

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-fbf820

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b-xsr94

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b-xsr94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b-xsr94

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-fbf820-546fc575cf-gmts2

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fbf820-546fc575cf-gmts2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-fbf820-546fc575cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-fbf820-546fc575cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-fbf820: serviceaccount "payload-processing-e2e-shared-b-w2-fbf820" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fbf820-546fc575cf-gmts2

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-aec3c2bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-aec3c2bf

openshift-ingress

deployment-controller

e2e-mt-aec3c2bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-aec3c2bf-openshift-default-fdf97f656 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-aec3c2bf-openshift-default-fdf97f656

SuccessfulCreate

Created pod: e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q

openshift-ingress

multus

e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6-cktg5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aec3c2bf-7f7947f7c7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-aec3c2bf-7f7947f7c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aec3c2bf: serviceaccount "payload-processing-e2e-mt-aec3c2bf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aec3c2bf-7f7947f7c7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-aec3c2bf-7f7947f7c7-thkmk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aec3c2bf: serviceaccount "payload-processing-e2e-mt-aec3c2bf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-aec3c2bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-aec3c2bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-aec3c2bf-7f7947f7c7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6-cktg5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-aec3c2bf-7f7947f7c7-thkmk

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-aec3c2bf-7f7947f7c7-thkmk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aec3c2bf-7f7947f7c7-thkmk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aec3c2bf-7f7947f7c7-thkmk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6-cktg5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6-cktg5

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6-cktg5

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aec3c2bf-65496bb9d6-cktg5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aec3c2bf-7f7947f7c7-thkmk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-aec3c2bf-openshift-default-fdf97f656-c8c9q

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-866a8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-866a8b

openshift-ingress

deployment-controller

e2e-api-a-866a8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-866a8b-openshift-default-585855d566 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-866a8b-openshift-default-585855d566

SuccessfulCreate

Created pod: e2e-api-a-866a8b-openshift-default-585855d566-lpffv

openshift-ingress

multus

e2e-api-a-866a8b-openshift-default-585855d566-lpffv

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-866a8b-664d66cbc7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-866a8b-664d66cbc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-866a8b: serviceaccount "payload-processing-e2e-api-a-866a8b" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-866a8b: serviceaccount "payload-processing-e2e-api-a-866a8b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-866a8b-664d66cbc7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-866a8b-664d66cbc7-nsc4j

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-866a8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-866a8b-664d66cbc7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-866a8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8-sfxb9

openshift-ingress

kubelet

payload-processing-e2e-api-a-866a8b-664d66cbc7-nsc4j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-866a8b-664d66cbc7-nsc4j

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8-sfxb9

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-866a8b-664d66cbc7-nsc4j

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8-sfxb9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8-sfxb9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-866a8b-664d66cbc7-nsc4j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8-sfxb9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-866a8b-openshift-default-585855d566-lpffv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-866a8b-openshift-default-585855d566-lpffv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-866a8b-openshift-default-585855d566-lpffv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-866a8b-openshift-default-585855d566-lpffv

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-b83cfe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b83cfe-openshift-default-7c494b587b from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-api-a-866a8b-openshift-default-585855d566-lpffv

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-b83cfe-openshift-default-7c494b587b

SuccessfulCreate

Created pod: e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

openshift-ingress

gateway_labeler_controller

e2e-api-b-b83cfe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b83cfe

openshift-ingress

multus

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b83cfe-799569dfff

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b83cfe-799569dfff-fbhds
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b83cfe: serviceaccount "payload-processing-e2e-api-b-b83cfe" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b83cfe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b83cfe-799569dfff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d-qtxkg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b83cfe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b83cfe-799569dfff

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b83cfe-799569dfff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b83cfe: serviceaccount "payload-processing-e2e-api-b-b83cfe" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d-qtxkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d-qtxkg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d-qtxkg

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b83cfe-799569dfff-fbhds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d-qtxkg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b83cfe-799569dfff-fbhds

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b83cfe-799569dfff-fbhds

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-b83cfe-799569dfff-fbhds

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-866a8b-664d66cbc7-nsc4j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-866a8b-5d7bcfc7c8-sfxb9

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-866a8b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-866a8b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-866a8b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-866a8b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7bb0b8cf-ed3a-4b75-bb3d-0af46f7e85c2, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-866a8b-openshift-default-585855d566-lpffv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-b83cfe-799569dfff-fbhds

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b83cfe-85bd647b7d-qtxkg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-b83cfe-openshift-default-7c494b587b-qskn4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72cb16-b9f649dc-hg725

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72cb16-85599c46f4-t8xf9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-72cb16-openshift-default-665bcd8d6d-fvvj5

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-fbf820

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fbf820: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-fbf820": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fbf820, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d5da0b84-70e2-4e70-b060-693809f76736, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fbf820-546fc575cf-gmts2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fbf820-7f46996b-xsr94

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": read tcp 10.132.0.2:33212->10.132.0.66:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w2-fbf820-openshift-default-b9dbbc5b-gkvff

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": read tcp 10.132.0.2:33212->10.132.0.66:15021: read: connection reset by peer body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-69ef21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-69ef21

openshift-ingress

replicaset-controller

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb

SuccessfulCreate

Created pod: e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

openshift-ingress

deployment-controller

e2e-ipp-a-69ef21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69ef21-openshift-default-5dddfbddcb from 0 to 1

openshift-ingress

multus

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69ef21: serviceaccount "payload-processing-e2e-ipp-a-69ef21" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-69ef21

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-69ef21-bfff87f47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69ef21-bfff87f47

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-69ef21-bfff87f47-jf6rh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69ef21-bfff87f47

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-69ef21-bfff87f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69ef21: serviceaccount "payload-processing-e2e-ipp-a-69ef21" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-69ef21

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6-smqls

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69ef21-bfff87f47-jf6rh

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-69ef21-bfff87f47-jf6rh

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6-smqls

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6-smqls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6-smqls

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69ef21-bfff87f47-jf6rh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69ef21-bfff87f47-jf6rh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6-smqls

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": read tcp 10.132.0.2:35098->10.132.0.81:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": read tcp 10.132.0.2:35098->10.132.0.81:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8c14da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8c14da

openshift-ingress

deployment-controller

e2e-ipp-b-8c14da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8c14da-openshift-default-76cc4c569d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-8c14da-openshift-default-76cc4c569d

SuccessfulCreate

Created pod: e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

openshift-ingress

multus

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5-g7s6x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8c14da: serviceaccount "payload-processing-e2e-ipp-b-8c14da" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6-682n2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8c14da: serviceaccount "payload-processing-e2e-ipp-b-8c14da" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8c14da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8c14da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6-682n2

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6-682n2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5-g7s6x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5-g7s6x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5-g7s6x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5-g7s6x

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6-682n2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6-682n2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

openshift-ingress

deployment-controller

e2e-ipp-cleanup-676ab2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-676ab2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-676ab2

openshift-ingress

multus

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d-9mnlv

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d-9mnlv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d-9mnlv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67-6qtzw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d-9mnlv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67-6qtzw

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-676ab2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67-6qtzw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67-6qtzw

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-676ab2: serviceaccount "payload-processing-e2e-ipp-cleanup-676ab2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d-9mnlv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-676ab2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-676ab2: serviceaccount "payload-processing-e2e-ipp-cleanup-676ab2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67-6qtzw

openshift-ingress

kubelet

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

ProbeError

Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": read tcp 10.132.0.2:42200->10.132.0.85:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

Unhealthy

Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": read tcp 10.132.0.2:42200->10.132.0.85:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-676ab2-55879bdf67-6qtzw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-676ab2-787944759d-9mnlv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-676ab2-openshift-default-54b7446bbd-8jz22

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69ef21-bfff87f47-jf6rh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69ef21-7d97c7dfd6-smqls

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-69ef21-openshift-default-5dddfbddcb-4wc6n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8c14da-9f8ddf9b5-g7s6x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8c14da-74b6445fd6-682n2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8c14da-openshift-default-76cc4c569d-6s8vh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2eb161-7d4f44d46-7jthw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2eb161-74458547d9-lp42r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-2eb161-openshift-default-5b675dc6b6-4vqc5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-eb4b45-8495c6d5b5-78dkv

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-eb4b45

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-eb4b45: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-eb4b45": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-eb4b45, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bd501494-9b1c-48f6-9d75-3235c1252964, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-eb4b45-6c5867c78-mr7w2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-eb4b45-openshift-default-7d8d65f8cd-5nqvs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503