Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7-grbxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7-grbxc to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db-m8kg2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db-m8kg2 to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-7nv2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-7nv2h to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98-sfqww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98-sfqww to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb-htj7n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb-htj7n to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-52dd3973-dd99bc64b-ttssr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-52dd3973-dd99bc64b-ttssr to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk to ip-10-0-141-40.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-4cj64

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4cj64 to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e89227-7dcc68f64f-pzs2m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e89227-7dcc68f64f-pzs2m to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-7a970e-6d75f7b887-rdtld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7a970e-6d75f7b887-rdtld to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-processing-e2e-autores-8de26b-97dd787f9-cklz2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-8de26b-97dd787f9-cklz2 to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs to ip-10-0-141-40.ec2.internal

openshift-ingress

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5 to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-processing-e2e-ait-aff377da-6476746869-jvkp2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-aff377da-6476746869-jvkp2 to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-2cjnv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-2cjnv to ip-10-0-128-153.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0024ffd2-587cd6875c-jljnv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0024ffd2-587cd6875c-jljnv to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-f39de1-78846c78f-tq9dq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f39de1-78846c78f-tq9dq to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-8355df-6b7b5459dc-4rsdc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-8355df-6b7b5459dc-4rsdc to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k to ip-10-0-141-40.ec2.internal

openshift-ingress

kube-auth-proxy-5f4449d5c7-r8559

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f4449d5c7-r8559 to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-420024-6766fb9cf5-qxjdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-420024-6766fb9cf5-qxjdk to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5cf411f1-7455664cd6-nrtlt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5cf411f1-7455664cd6-nrtlt to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66-whd2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66-whd2h to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766-4khqr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766-4khqr to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb-j8flr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb-j8flr to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8-xgbb7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8-xgbb7 to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-tpc7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-tpc7d to ip-10-0-128-153.ec2.internal

openshift-ingress

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8 to ip-10-0-141-40.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-7c6rv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7c6rv to ip-10-0-128-153.ec2.internal

openshift-ingress

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8 to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-4c9990-56698dc65d-rq86w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-4c9990-56698dc65d-rq86w to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-sfbjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-sfbjs to ip-10-0-141-40.ec2.internal

openshift-ingress

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh to ip-10-0-141-40.ec2.internal

openshift-ingress

router-default-664cd9c55b-hvdjv

Scheduled

Successfully assigned openshift-ingress/router-default-664cd9c55b-hvdjv to ip-10-0-128-153.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb-6b9gj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb-6b9gj to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc-48v58

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc-48v58 to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-282355-75dbb994d5-nm5b4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-282355-75dbb994d5-nm5b4 to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7-2psdt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7-2psdt to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7-jhn2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7-jhn2h to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5cf411f1-c79bf9d6f-2jlcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5cf411f1-c79bf9d6f-2jlcr to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-processing-e2e-mt-52dd3973-7bcf68cf97-dz7gc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-52dd3973-7bcf68cf97-dz7gc to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-913c8e9c-6f78c859d6-2ds5l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-913c8e9c-6f78c859d6-2ds5l to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4 to ip-10-0-141-40.ec2.internal

openshift-ingress

e2e-noten-395207-openshift-default-5d55cd987b-g6h28

Scheduled

Successfully assigned openshift-ingress/e2e-noten-395207-openshift-default-5d55cd987b-g6h28 to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-aff377da-8dc44cc6b-mjfp8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-aff377da-8dc44cc6b-mjfp8 to ip-10-0-141-40.ec2.internal

openshift-ingress

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6 to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8-kxw5f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8-kxw5f to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq to ip-10-0-141-40.ec2.internal

openshift-ingress

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5 to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-8de26b-dcf4f46d6-qmq7h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-8de26b-dcf4f46d6-qmq7h to ip-10-0-132-86.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb-v2db9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb-v2db9 to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e89227-86d867946-mxbpg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e89227-86d867946-mxbpg to ip-10-0-141-40.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-888xd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-888xd to ip-10-0-128-153.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-4c9990-76f564bc5f-g44d2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-4c9990-76f564bc5f-g44d2 to ip-10-0-132-86.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-x5kr6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5kr6 to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-processing-e2e-ait-54215d39-7645f59885-74thh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-54215d39-7645f59885-74thh to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c-bt9t6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c-bt9t6 to ip-10-0-132-86.ec2.internal

openshift-ingress

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6 to ip-10-0-141-40.ec2.internal

openshift-ingress

e2e-autores-8de26b-openshift-default-774f69876-tkckj

Scheduled

Successfully assigned openshift-ingress/e2e-autores-8de26b-openshift-default-774f69876-tkckj to ip-10-0-141-40.ec2.internal

openshift-ingress

e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b to ip-10-0-141-40.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-54215d39-67b96dcf5d-qcjzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-54215d39-67b96dcf5d-qcjzv to ip-10-0-132-86.ec2.internal

openshift-ingress

kube-auth-proxy-5f4449d5c7-kgz46

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f4449d5c7-kgz46 to ip-10-0-128-153.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-664cd9c55b from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-664cd9c55b

FailedCreate

Error creating: pods "router-default-664cd9c55b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-664cd9c55b

FailedCreate

Error creating: pods "router-default-664cd9c55b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-664cd9c55b

SuccessfulCreate

Created pod: router-default-664cd9c55b-hvdjv
(x6)

openshift-ingress

kubelet

router-default-664cd9c55b-hvdjv

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-664cd9c55b-hvdjv

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-664cd9c55b-hvdjv

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-664cd9c55b-hvdjv

Started

Started container router

openshift-ingress

kubelet

router-default-664cd9c55b-hvdjv

Created

Created container: router

openshift-ingress

multus

router-default-664cd9c55b-hvdjv

AddedInterface

Add eth0 [10.133.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f4449d5c7-r8559

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-5f4449d5c7

FailedCreate

Error creating: pods "kube-auth-proxy-5f4449d5c7-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5f4449d5c7

SuccessfulCreate

Created pod: kube-auth-proxy-5f4449d5c7-kgz46

openshift-ingress

replicaset-controller

kube-auth-proxy-5f4449d5c7

SuccessfulCreate

Created pod: kube-auth-proxy-5f4449d5c7-r8559

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5f4449d5c7 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-5f4449d5c7-kgz46

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f4449d5c7-r8559

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5f4449d5c7-r8559

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f4449d5c7-kgz46

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-7c6rv

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-7c6rv

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7c6rv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5f4449d5c7-r8559

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.543s (2.543s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5f4449d5c7-r8559

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f4449d5c7-r8559

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f4449d5c7-kgz46

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f4449d5c7-kgz46

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.458s (5.458s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5f4449d5c7-kgz46

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7c6rv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7c6rv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.27s (3.27s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7c6rv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7c6rv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-x5kr6

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7c6rv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x5kr6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-888xd

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-x5kr6

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-888xd

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-888xd

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-888xd

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-888xd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x5kr6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.621s (2.622s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x5kr6

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x5kr6

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-888xd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-888xd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-7c6rv

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7c6rv

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-4cj64

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-4cj64

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-tpc7d

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-2cjnv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-tpc7d

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-tpc7d

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2cjnv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-2cjnv

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2cjnv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-tpc7d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.098s (2.098s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2cjnv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.125s (2.125s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2cjnv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-tpc7d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-tpc7d

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4cj64

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4cj64

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4cj64

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4cj64

Unhealthy

Startup probe failed: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4cj64

ProbeError

Startup probe error: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-8355df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-8355df

openshift-ingress

deployment-controller

e2e-inf-a-8355df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-8355df-openshift-default-65f448cd5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-8355df-openshift-default-65f448cd5b

SuccessfulCreate

Created pod: e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

openshift-ingress

multus

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-8355df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8355df: serviceaccount "payload-processing-e2e-inf-a-8355df" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-sfbjs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8355df-6b7b5459dc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-8355df-6b7b5459dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8355df: serviceaccount "payload-processing-e2e-inf-a-8355df" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8355df-6b7b5459dc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-8355df-6b7b5459dc-4rsdc

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-8355df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-8355df-6b7b5459dc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-sfbjs

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-sfbjs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-8355df-6b7b5459dc-4rsdc

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8355df-6b7b5459dc-4rsdc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8355df-6b7b5459dc-4rsdc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8355df-6b7b5459dc-4rsdc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.918s (1.918s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8355df-6b7b5459dc-4rsdc

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-aff377da-openshift-default-5dcf85466

SuccessfulCreate

Created pod: e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

openshift-ingress

gateway_labeler_controller

e2e-ait-aff377da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-aff377da

openshift-ingress

multus

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-aff377da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-aff377da-openshift-default-5dcf85466 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-sfbjs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.598s (2.598s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-sfbjs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-sfbjs

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-8de26b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-8de26b

openshift-ingress

multus

e2e-autores-8de26b-openshift-default-774f69876-tkckj

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-8de26b-openshift-default-774f69876

SuccessfulCreate

Created pod: e2e-autores-8de26b-openshift-default-774f69876-tkckj

openshift-ingress

deployment-controller

e2e-autores-8de26b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-8de26b-openshift-default-774f69876 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-aff377da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-aff377da-6476746869 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-aff377da-6476746869

FailedCreate

Error creating: pods "payload-processing-e2e-ait-aff377da-6476746869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-aff377da: serviceaccount "payload-processing-e2e-ait-aff377da" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-aff377da-8dc44cc6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-aff377da-8dc44cc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-aff377da: serviceaccount "payload-processing-e2e-ait-aff377da" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-aff377da-8dc44cc6b-mjfp8

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-aff377da-6476746869-jvkp2

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-aff377da-8dc44cc6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-aff377da-8dc44cc6b-mjfp8

openshift-ingress

kubelet

payload-processing-e2e-ait-aff377da-6476746869-jvkp2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-aff377da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-aff377da-8dc44cc6b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-aff377da-6476746869

SuccessfulCreate

Created pod: payload-processing-e2e-ait-aff377da-6476746869-jvkp2

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aff377da-8dc44cc6b-mjfp8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-aff377da-6476746869-jvkp2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-aff377da-6476746869-jvkp2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aff377da-8dc44cc6b-mjfp8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aff377da-8dc44cc6b-mjfp8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-8de26b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-8de26b-dcf4f46d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-8de26b-97dd787f9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-8de26b-97dd787f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-8de26b: serviceaccount "payload-processing-e2e-autores-8de26b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-8de26b-dcf4f46d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-8de26b-dcf4f46d6-qmq7h

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-8de26b-97dd787f9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-8de26b-97dd787f9-cklz2

openshift-ingress

deployment-controller

payload-processing-e2e-autores-8de26b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-8de26b-97dd787f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-8de26b-dcf4f46d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-8de26b-dcf4f46d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-8de26b: serviceaccount "payload-processing-e2e-autores-8de26b" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-8de26b-dcf4f46d6-qmq7h

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8de26b-dcf4f46d6-qmq7h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8de26b-dcf4f46d6-qmq7h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8de26b-dcf4f46d6-qmq7h

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-8de26b-97dd787f9-cklz2

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-8de26b-97dd787f9-cklz2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-8de26b-97dd787f9-cklz2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-8de26b-97dd787f9-cklz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

ProbeError

Readiness probe error: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

Unhealthy

Readiness probe failed: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

ProbeError

Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

Unhealthy

Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-4c9990

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-4c9990

openshift-ingress

multus

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-4c9990-openshift-default-59fb697cb4

SuccessfulCreate

Created pod: e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

openshift-ingress

deployment-controller

e2e-inf-b-4c9990-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-4c9990-openshift-default-59fb697cb4 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-4c9990

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-4c9990-76f564bc5f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-8de26b-openshift-default-774f69876-tkckj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-8de26b-openshift-default-774f69876-tkckj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-8de26b-openshift-default-774f69876-tkckj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4c9990-56698dc65d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-4c9990-56698dc65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4c9990: serviceaccount "payload-processing-e2e-inf-b-4c9990" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4c9990-76f564bc5f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-4c9990-76f564bc5f-g44d2

openshift-ingress

multus

payload-processing-e2e-inf-b-4c9990-76f564bc5f-g44d2

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4c9990-76f564bc5f-g44d2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4c9990-76f564bc5f-g44d2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4c9990-76f564bc5f-g44d2

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4c9990-76f564bc5f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-4c9990-76f564bc5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4c9990: serviceaccount "payload-processing-e2e-inf-b-4c9990" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4c9990-56698dc65d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-4c9990-56698dc65d-rq86w

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-4c9990-56698dc65d-rq86w

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4c9990-56698dc65d-rq86w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4c9990-56698dc65d-rq86w

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-4c9990

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-4c9990-56698dc65d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4c9990-56698dc65d-rq86w

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-autores-8de26b-openshift-default-774f69876-tkckj

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-8de26b-openshift-default-774f69876-tkckj

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-aff377da-openshift-default-5dcf85466-fkzsz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-aff377da-6476746869-jvkp2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aff377da-8dc44cc6b-mjfp8

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-migrate-913c8e9c-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-913c8e9c-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-913c8e9c-gw

openshift-ingress

replicaset-controller

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb

SuccessfulCreate

Created pod: e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

openshift-ingress

multus

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-913c8e9c: serviceaccount "payload-processing-e2e-migrate-913c8e9c" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-913c8e9c-6f78c859d6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-913c8e9c-6f78c859d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-913c8e9c: serviceaccount "payload-processing-e2e-migrate-913c8e9c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-913c8e9c-6f78c859d6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-913c8e9c-6f78c859d6-2ds5l

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-913c8e9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-913c8e9c-6f78c859d6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-913c8e9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb-htj7n

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb-htj7n

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-913c8e9c-6f78c859d6-2ds5l

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-913c8e9c-6f78c859d6-2ds5l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-913c8e9c-6f78c859d6-2ds5l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb-htj7n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-913c8e9c-6f78c859d6-2ds5l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb-htj7n

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb-htj7n

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-913c8e9c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-913c8e9c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-913c8e9c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-913c8e9c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cb348b0e-7f34-4d3e-81c4-7f546fc8cdff, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-913c8e9c-649bdbfddb-htj7n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-913c8e9c-6f78c859d6-2ds5l

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-54215d39-openshift-default-684d64c59d

SuccessfulCreate

Created pod: e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

openshift-ingress

gateway_labeler_controller

e2e-ait-54215d39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-54215d39

openshift-ingress

deployment-controller

e2e-ait-54215d39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-54215d39-openshift-default-684d64c59d from 0 to 1

openshift-ingress

kubelet

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-913c8e9c-gw-openshift-default-75d474d6fb-7xrj5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-54215d39-7645f59885

FailedCreate

Error creating: pods "payload-processing-e2e-ait-54215d39-7645f59885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54215d39: serviceaccount "payload-processing-e2e-ait-54215d39" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-54215d39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-54215d39-67b96dcf5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-54215d39-67b96dcf5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-54215d39-67b96dcf5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54215d39: serviceaccount "payload-processing-e2e-ait-54215d39" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-54215d39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-54215d39-7645f59885 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-54215d39-67b96dcf5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-54215d39-67b96dcf5d-qcjzv

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-54215d39-7645f59885

SuccessfulCreate

Created pod: payload-processing-e2e-ait-54215d39-7645f59885-74thh

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54215d39-67b96dcf5d-qcjzv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-54215d39-7645f59885-74thh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-54215d39-7645f59885-74thh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54215d39-67b96dcf5d-qcjzv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-54215d39-7645f59885-74thh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54215d39-67b96dcf5d-qcjzv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-54215d39-67b96dcf5d-qcjzv

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-54215d39-7645f59885-74thh

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-54215d39

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-54215d39: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-54215d39": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-54215d39, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9ad3c436-70ec-4464-93ed-a65995d91cf7, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-54215d39-7645f59885-74thh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54215d39-67b96dcf5d-qcjzv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-0024ffd2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0024ffd2

openshift-ingress

deployment-controller

e2e-derive-0024ffd2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0024ffd2-openshift-default-7d4b6b55fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb

SuccessfulCreate

Created pod: e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

openshift-ingress

multus

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-54215d39-openshift-default-684d64c59d-j8bbk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0024ffd2-587cd6875c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0024ffd2-587cd6875c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0024ffd2: serviceaccount "payload-processing-e2e-derive-0024ffd2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0024ffd2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0024ffd2-587cd6875c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0024ffd2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8-kxw5f

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0024ffd2-587cd6875c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0024ffd2-587cd6875c-jljnv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0024ffd2: serviceaccount "payload-processing-e2e-derive-0024ffd2" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8-kxw5f

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-0024ffd2-587cd6875c-jljnv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8-kxw5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8-kxw5f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8-kxw5f

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-0024ffd2-587cd6875c-jljnv

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-0024ffd2-587cd6875c-jljnv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-0024ffd2-587cd6875c-jljnv

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-0024ffd2-587cd6875c-jljnv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-8de26b-97dd787f9-cklz2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0024ffd2-68d7f895c8-kxw5f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-8de26b-dcf4f46d6-qmq7h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-0024ffd2-openshift-default-7d4b6b55fb-b9f5k

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-explicit-f39de1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f39de1

openshift-ingress

replicaset-controller

e2e-explicit-f39de1-openshift-default-6bf685d45b

SuccessfulCreate

Created pod: e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

openshift-ingress

deployment-controller

e2e-explicit-f39de1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f39de1-openshift-default-6bf685d45b from 0 to 1

openshift-ingress

kubelet

e2e-autores-8de26b-openshift-default-774f69876-tkckj

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f39de1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f39de1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f39de1-78846c78f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb-6b9gj

openshift-ingress

kubelet

payload-processing-e2e-explicit-f39de1-78846c78f-tq9dq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb-6b9gj

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f39de1-78846c78f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f39de1-78846c78f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f39de1: serviceaccount "payload-processing-e2e-explicit-f39de1" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f39de1: serviceaccount "payload-processing-e2e-explicit-f39de1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb-6b9gj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f39de1-78846c78f-tq9dq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f39de1-78846c78f-tq9dq

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f39de1-78846c78f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f39de1-78846c78f-tq9dq

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb-6b9gj

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-f39de1-78846c78f-tq9dq

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb-6b9gj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f39de1-84d7c74cdb-6b9gj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f39de1-78846c78f-tq9dq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-395207-openshift-default-5d55cd987b-g6h28

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-395207-openshift-default-5d55cd987b

SuccessfulCreate

Created pod: e2e-noten-395207-openshift-default-5d55cd987b-g6h28

openshift-ingress

deployment-controller

e2e-noten-395207-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-395207-openshift-default-5d55cd987b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-395207

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-395207

openshift-ingress

kubelet

e2e-noten-395207-openshift-default-5d55cd987b-g6h28

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-395207-openshift-default-5d55cd987b-g6h28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-395207-openshift-default-5d55cd987b-g6h28

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-f39de1-openshift-default-6bf685d45b-x52gs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-5cf411f1-openshift-default-7db87856f6

SuccessfulCreate

Created pod: e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

openshift-ingress

gateway_labeler_controller

e2e-mt-5cf411f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5cf411f1

openshift-ingress

deployment-controller

e2e-mt-5cf411f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5cf411f1-openshift-default-7db87856f6 from 0 to 1

openshift-ingress

multus

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-395207-openshift-default-5d55cd987b-g6h28

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5cf411f1-c79bf9d6f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5cf411f1-c79bf9d6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5cf411f1: serviceaccount "payload-processing-e2e-mt-5cf411f1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5cf411f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5cf411f1-7455664cd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5cf411f1-c79bf9d6f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5cf411f1-c79bf9d6f-2jlcr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5cf411f1-7455664cd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5cf411f1-7455664cd6-nrtlt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5cf411f1-7455664cd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5cf411f1-7455664cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5cf411f1: serviceaccount "payload-processing-e2e-mt-5cf411f1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5cf411f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5cf411f1-c79bf9d6f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5cf411f1-7455664cd6-nrtlt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-5cf411f1-7455664cd6-nrtlt

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-5cf411f1-c79bf9d6f-2jlcr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5cf411f1-7455664cd6-nrtlt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5cf411f1-7455664cd6-nrtlt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-5cf411f1-c79bf9d6f-2jlcr

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-5cf411f1-c79bf9d6f-2jlcr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-5cf411f1-c79bf9d6f-2jlcr

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-8355df

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-8355df: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-8355df": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-8355df, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 289d0ad6-92e7-4bb3-a431-080563613906, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8355df-75b4bcff4b-sfbjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8355df-6b7b5459dc-4rsdc

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-8355df-openshift-default-65f448cd5b-wmfxx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4c9990-76f564bc5f-g44d2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4c9990-56698dc65d-rq86w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5cf411f1-7455664cd6-nrtlt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-5cf411f1-c79bf9d6f-2jlcr

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-5fde2a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-5fde2a

openshift-ingress

kubelet

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-4c9990-openshift-default-59fb697cb4-5h9g6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-5fde2a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d

SuccessfulCreate

Created pod: e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b

openshift-ingress

multus

e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-5fde2a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-5fde2a: serviceaccount "payload-processing-e2e-shared-a-w3-5fde2a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766-4khqr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-5fde2a: serviceaccount "payload-processing-e2e-shared-a-w3-5fde2a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7-2psdt

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-5fde2a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766-4khqr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-5cf411f1-openshift-default-7db87856f6-zj9l8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766-4khqr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766-4khqr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766-4khqr

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7-2psdt

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7-2psdt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7-2psdt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7-2psdt

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648

SuccessfulCreate

Created pod: e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

openshift-ingress

deployment-controller

e2e-shared-a-w2-c2e44c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-c2e44c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-c2e44c
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c2e44c: serviceaccount "payload-processing-e2e-shared-a-w2-c2e44c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-c2e44c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66-whd2h
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c2e44c: serviceaccount "payload-processing-e2e-shared-a-w2-c2e44c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-c2e44c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7-jhn2h

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66-whd2h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7-jhn2h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7-jhn2h

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66-whd2h

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66-whd2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66-whd2h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7-jhn2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7-jhn2h

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd

SuccessfulCreate

Created pod: e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-13c392

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-13c392

openshift-ingress

deployment-controller

e2e-shared-b-w3-13c392-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-13c392-openshift-default-7dfc846bd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-13c392

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-13c392

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8-xgbb7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-13c392: serviceaccount "payload-processing-e2e-shared-b-w3-13c392" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc-48v58
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-13c392: serviceaccount "payload-processing-e2e-shared-b-w3-13c392" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc-48v58

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc-48v58

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc-48v58

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc-48v58

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8-xgbb7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8-xgbb7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8-xgbb7

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8-xgbb7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

Unhealthy

Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

ProbeError

Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w2-282355-openshift-default-84b9cb468b

SuccessfulCreate

Created pod: e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-282355

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-282355

openshift-ingress

deployment-controller

e2e-shared-b-w2-282355-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-282355-openshift-default-84b9cb468b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-282355-75dbb994d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-282355-75dbb994d5-nm5b4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-282355-75dbb994d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-282355-75dbb994d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-282355: serviceaccount "payload-processing-e2e-shared-b-w2-282355" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-282355

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb-j8flr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-282355: serviceaccount "payload-processing-e2e-shared-b-w2-282355" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-282355

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-282355-75dbb994d5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-282355-75dbb994d5-nm5b4

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-282355-75dbb994d5-nm5b4

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb-j8flr

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb-j8flr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb-j8flr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb-j8flr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-282355-75dbb994d5-nm5b4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-282355-75dbb994d5-nm5b4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-52dd3973

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-52dd3973

openshift-ingress

deployment-controller

e2e-mt-52dd3973-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-52dd3973-openshift-default-554fdd8584 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-52dd3973-openshift-default-554fdd8584

SuccessfulCreate

Created pod: e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

openshift-ingress

deployment-controller

payload-processing-e2e-mt-52dd3973

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-52dd3973-7bcf68cf97 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-52dd3973-7bcf68cf97-dz7gc

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-52dd3973-7bcf68cf97-dz7gc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-52dd3973-dd99bc64b-ttssr

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-52dd3973-7bcf68cf97

SuccessfulCreate

Created pod: payload-processing-e2e-mt-52dd3973-7bcf68cf97-dz7gc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-52dd3973-7bcf68cf97

FailedCreate

Error creating: pods "payload-processing-e2e-mt-52dd3973-7bcf68cf97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-52dd3973: serviceaccount "payload-processing-e2e-mt-52dd3973" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-52dd3973-7bcf68cf97-dz7gc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-52dd3973-dd99bc64b-ttssr

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-52dd3973

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-52dd3973-dd99bc64b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-52dd3973-dd99bc64b-ttssr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-52dd3973-dd99bc64b-ttssr

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-52dd3973-dd99bc64b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-52dd3973-dd99bc64b-ttssr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-52dd3973-dd99bc64b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-52dd3973-dd99bc64b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-52dd3973: serviceaccount "payload-processing-e2e-mt-52dd3973" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-52dd3973-7bcf68cf97-dz7gc

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-52dd3973

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-52dd3973: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-52dd3973": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-52dd3973, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f64e685b-0bae-4f29-ab8c-62cd52b9bd04, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-52dd3973-dd99bc64b-ttssr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-52dd3973-7bcf68cf97-dz7gc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-52dd3973-openshift-default-554fdd8584-gnzhv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-e89227-openshift-default-5fd454f558

SuccessfulCreate

Created pod: e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

openshift-ingress

deployment-controller

e2e-api-a-e89227-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e89227-openshift-default-5fd454f558 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-e89227

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e89227

openshift-ingress

multus

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-e89227-7dcc68f64f-pzs2m

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e89227-86d867946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e89227-86d867946-mxbpg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e89227-7dcc68f64f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e89227-7dcc68f64f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e89227: serviceaccount "payload-processing-e2e-api-a-e89227" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e89227-7dcc68f64f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e89227-7dcc68f64f-pzs2m

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e89227

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e89227-7dcc68f64f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e89227-86d867946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e89227-86d867946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e89227: serviceaccount "payload-processing-e2e-api-a-e89227" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e89227

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e89227-86d867946 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-e89227-7dcc68f64f-pzs2m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e89227-86d867946-mxbpg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e89227-86d867946-mxbpg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e89227-86d867946-mxbpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e89227-86d867946-mxbpg

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-e89227-7dcc68f64f-pzs2m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-e89227-7dcc68f64f-pzs2m

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-7a970e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7a970e

openshift-ingress

GatewayAuthBootstrap

e2e-api-b-7a970e

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-b-7a970e-authn-ssl: envoyfilters.networking.istio.io "e2e-api-b-7a970e-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-api-b-7a970e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7a970e-openshift-default-6f6c75fd7b from 0 to 1

openshift-ingress

multus

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-7a970e-openshift-default-6f6c75fd7b

SuccessfulCreate

Created pod: e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7a970e-6d75f7b887

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7a970e-6d75f7b887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7a970e: serviceaccount "payload-processing-e2e-api-b-7a970e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7a970e-6d75f7b887

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7a970e-6d75f7b887-rdtld
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7a970e: serviceaccount "payload-processing-e2e-api-b-7a970e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb-v2db9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7a970e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7a970e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7a970e-6d75f7b887 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-7a970e-6d75f7b887-rdtld

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb-v2db9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-7a970e-6d75f7b887-rdtld

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7a970e-6d75f7b887-rdtld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-7a970e-6d75f7b887-rdtld

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb-v2db9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb-v2db9

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb-v2db9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

Unhealthy

Readiness probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

ProbeError

Readiness probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-e89227-7dcc68f64f-pzs2m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e89227-86d867946-mxbpg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-e89227-openshift-default-5fd454f558-bc2mh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-7a970e-6d75f7b887-rdtld

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7a970e-d9f8cbbb-v2db9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-7a970e-openshift-default-6f6c75fd7b-dp4s6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c2e44c-85d8bd8bd7-jhn2h

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-c2e44c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c2e44c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-c2e44c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c2e44c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0fb6d5e2-c807-46a0-8055-3a0a82355cf7, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c2e44c-99c996d66-whd2h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-c2e44c-openshift-default-5df7dc4648-px9q5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3f4d4b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3f4d4b

openshift-ingress

replicaset-controller

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb

SuccessfulCreate

Created pod: e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

openshift-ingress

deployment-controller

e2e-ipp-a-3f4d4b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3f4d4b-openshift-default-6944947bcb from 0 to 1

openshift-ingress

multus

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-282355-75dbb994d5-nm5b4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-282355-58b5f97fbb-j8flr

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3f4d4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f4d4b: serviceaccount "payload-processing-e2e-ipp-a-3f4d4b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db-m8kg2

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3f4d4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c-bt9t6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f4d4b: serviceaccount "payload-processing-e2e-ipp-a-3f4d4b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db-m8kg2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c-bt9t6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c-bt9t6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c-bt9t6

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db-m8kg2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db-m8kg2

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db-m8kg2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c-bt9t6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-282355-openshift-default-84b9cb468b-hlfnq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-420024-openshift-default-67c98f74f6

SuccessfulCreate

Created pod: e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-420024

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-420024

openshift-ingress

deployment-controller

e2e-ipp-b-420024-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-420024-openshift-default-67c98f74f6 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-420024

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-420024-6766fb9cf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-420024-6766fb9cf5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-420024-6766fb9cf5-qxjdk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-420024-6766fb9cf5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-420024-6766fb9cf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-420024: serviceaccount "payload-processing-e2e-ipp-b-420024" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-420024

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-420024-5cc769c9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-420024-5cc769c9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-7nv2h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-420024-5cc769c9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-420024: serviceaccount "payload-processing-e2e-ipp-b-420024" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-420024-6766fb9cf5-qxjdk

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-7nv2h

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-7nv2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-7nv2h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-7nv2h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-420024-6766fb9cf5-qxjdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-420024-6766fb9cf5-qxjdk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-420024-6766fb9cf5-qxjdk

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

Unhealthy

Readiness probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

ProbeError

Readiness probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

openshift-ingress

deployment-controller

e2e-ipp-cleanup-34501f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-34501f-openshift-default-575f67df7d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-34501f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-34501f

openshift-ingress

multus

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-34501f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-34501f: serviceaccount "payload-processing-e2e-ipp-cleanup-34501f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7-grbxc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-34501f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-34501f: serviceaccount "payload-processing-e2e-ipp-cleanup-34501f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98-sfqww

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98-sfqww

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7-grbxc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98-sfqww

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7-grbxc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98-sfqww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7-grbxc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7-grbxc

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98-sfqww

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-34501f-797d748b98-sfqww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-34501f-cdbd85ff7-grbxc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-34501f-openshift-default-575f67df7d-64vx4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f4d4b-5fd694f6db-m8kg2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f4d4b-84d66d4c8c-bt9t6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-3f4d4b-openshift-default-6944947bcb-lhng8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-420024-6766fb9cf5-qxjdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-420024-6766fb9cf5-qxjdk

Unhealthy

Readiness probe failed: dial tcp 10.132.0.80:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-7nv2h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-420024-5cc769c9d-7nv2h

Unhealthy

Readiness probe failed: dial tcp 10.132.0.79:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-420024-openshift-default-67c98f74f6-vvbql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5fde2a-5998598766-4khqr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5fde2a-589cd478f7-2psdt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-5fde2a-openshift-default-9f7ffd45d-lsz2b

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-13c392

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-13c392: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-13c392": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-13c392, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cc888b9a-7833-4402-b613-4988f9def3e7, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-13c392-d496bcc8-xgbb7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-13c392-64fcdbdcdc-48v58

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-13c392-openshift-default-7dfc846bd-5mb7b

Killing

Stopping container istio-proxy