Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j to ip-10-0-141-32.ec2.internal

openshift-ingress

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2 to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88-88hqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88-88hqp to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

Scheduled

Successfully assigned openshift-ingress/e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb-xvh5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb-xvh5d to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg to ip-10-0-141-32.ec2.internal

openshift-ingress

e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6 to ip-10-0-132-244.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-pscbn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-pscbn to ip-10-0-141-32.ec2.internal

openshift-ingress

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

Scheduled

Successfully assigned openshift-ingress/e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q to ip-10-0-132-244.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-bp8j4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bp8j4 to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5 to ip-10-0-132-244.ec2.internal

openshift-ingress

kube-auth-proxy-949fd4987-nmvwf

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-949fd4987-nmvwf to ip-10-0-129-103.ec2.internal

openshift-ingress

kube-auth-proxy-949fd4987-nqzgw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-949fd4987-nqzgw to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4 to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-n54d2

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-n54d2 to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw to ip-10-0-141-32.ec2.internal

openshift-ingress

router-default-85766f5879-5lm2d

Scheduled

Successfully assigned openshift-ingress/router-default-85766f5879-5lm2d to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-f99bfd-c67cbdc94-zf72r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-f99bfd-c67cbdc94-zf72r to ip-10-0-132-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-tqprs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-tqprs to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-djt9q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-djt9q to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9 to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-791fb5-74fb59455b-zhd6j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-791fb5-74fb59455b-zhd6j to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6 to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-941fec-57db54b78-gq6k5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-941fec-57db54b78-gq6k5 to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-2eb089-755f998d4-84qgn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2eb089-755f998d4-84qgn to ip-10-0-141-32.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cl7z6q

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cl7z6q to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-ait-68303af4-646f9df866-77pp4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-68303af4-646f9df866-77pp4 to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-68303af4-577d645b8d-4prd7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-68303af4-577d645b8d-4prd7 to ip-10-0-132-244.ec2.internal

openshift-ingress

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-941fec-58fc7d8db4-qs485

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-941fec-58fc7d8db4-qs485 to ip-10-0-132-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk to ip-10-0-141-32.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9 to ip-10-0-141-32.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-85766f5879 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-85766f5879

FailedCreate

Error creating: pods "router-default-85766f5879-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-85766f5879

FailedCreate

Error creating: pods "router-default-85766f5879-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-85766f5879

SuccessfulCreate

Created pod: router-default-85766f5879-5lm2d
(x6)

openshift-ingress

kubelet

router-default-85766f5879-5lm2d

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-85766f5879-5lm2d

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-85766f5879-5lm2d

Started

Started container router

openshift-ingress

multus

router-default-85766f5879-5lm2d

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-85766f5879-5lm2d

Created

Created container: router

openshift-ingress

kubelet

router-default-85766f5879-5lm2d

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-949fd4987 from 0 to 2
(x6)

openshift-ingress

replicaset-controller

kube-auth-proxy-949fd4987

FailedCreate

Error creating: pods "kube-auth-proxy-949fd4987-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-949fd4987-nqzgw

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-949fd4987

SuccessfulCreate

Created pod: kube-auth-proxy-949fd4987-nmvwf

openshift-ingress

replicaset-controller

kube-auth-proxy-949fd4987

SuccessfulCreate

Created pod: kube-auth-proxy-949fd4987-nqzgw

openshift-ingress

kubelet

kube-auth-proxy-949fd4987-nmvwf

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-949fd4987-nqzgw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-949fd4987-nmvwf

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-bp8j4

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-bp8j4

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bp8j4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-949fd4987-nmvwf

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-949fd4987-nmvwf

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-949fd4987-nmvwf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.285s (2.285s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-949fd4987-nqzgw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.987s (3.987s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-949fd4987-nqzgw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-949fd4987-nqzgw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bp8j4

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bp8j4

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bp8j4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.467s (4.467s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cl7z6q

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bp8j4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bp8j4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-pscbn

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pscbn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-pscbn

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cl7z6q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cl7z6q

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pscbn

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pscbn

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pscbn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.673s (2.673s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bp8j4

ProbeError

Readiness probe error: Get "http://10.132.0.32:8080/ready": dial tcp 10.132.0.32:8080: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cl7z6q

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-bp8j4

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cl7z6q

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cl7z6q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.137s (3.137s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bp8j4

Unhealthy

Readiness probe failed: Get "http://10.132.0.32:8080/ready": dial tcp 10.132.0.32:8080: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bp8j4

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-tqprs

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-tqprs

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-djt9q

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5cc6cd444b-n54d2

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-n54d2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-n54d2

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-djt9q

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-djt9q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5cc6cd444b-n54d2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-n54d2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-djt9q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.444s (2.444s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-djt9q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-djt9q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-n54d2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.437s (2.437s including waiting). Image size: 165907129 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tqprs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tqprs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tqprs

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tqprs

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tqprs

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ait-68303af4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-68303af4-openshift-default-5cbf67dfb6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-68303af4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-68303af4

openshift-ingress

replicaset-controller

e2e-ait-68303af4-openshift-default-5cbf67dfb6

SuccessfulCreate

Created pod: e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

openshift-ingress

multus

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-68303af4-646f9df866-77pp4

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-68303af4-646f9df866

FailedCreate

Error creating: pods "payload-processing-e2e-ait-68303af4-646f9df866-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-68303af4: serviceaccount "payload-processing-e2e-ait-68303af4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-68303af4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-68303af4-577d645b8d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-68303af4-577d645b8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-68303af4-577d645b8d-4prd7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-68303af4-577d645b8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-68303af4-577d645b8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-68303af4: serviceaccount "payload-processing-e2e-ait-68303af4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-68303af4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-68303af4-646f9df866 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-68303af4-577d645b8d-4prd7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-68303af4-577d645b8d-4prd7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-68303af4-577d645b8d-4prd7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-68303af4-577d645b8d-4prd7

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-68303af4-646f9df866-77pp4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-68303af4-646f9df866-77pp4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-68303af4-646f9df866-77pp4

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-68303af4-646f9df866

SuccessfulCreate

Created pod: payload-processing-e2e-ait-68303af4-646f9df866-77pp4

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-68303af4-577d645b8d-4prd7

Unhealthy

Readiness probe failed: dial tcp 10.132.0.63:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-68303af4-646f9df866-77pp4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-68303af4-577d645b8d-4prd7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-68303af4-openshift-default-5cbf67dfb6-l7m4q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d

SuccessfulCreate

Created pod: e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

openshift-ingress

multus

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-a312c841-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a312c841-gw-openshift-default-6664d64b6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-a312c841-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a312c841-gw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a312c841

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb-xvh5d
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a312c841-5ff7ff959c

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a312c841-5ff7ff959c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a312c841: serviceaccount "payload-processing-e2e-migrate-a312c841" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a312c841-5ff7ff959c

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a312c841

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a312c841-5ff7ff959c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a312c841: serviceaccount "payload-processing-e2e-migrate-a312c841" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb-xvh5d

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb-xvh5d

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb-xvh5d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb-xvh5d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.254s (2.254s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": read tcp 10.132.0.2:36574->10.132.0.65:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": read tcp 10.132.0.2:36574->10.132.0.65:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a312c841-7fbb5dd4fb-xvh5d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a312c841-5ff7ff959c-c5chc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-a312c841-gw-openshift-default-6664d64b6d-4bdwb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-0b0189d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0b0189d4

openshift-ingress

deployment-controller

e2e-ait-0b0189d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0b0189d4-openshift-default-66897454b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-0b0189d4-openshift-default-66897454b8

SuccessfulCreate

Created pod: e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

openshift-ingress

multus

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0b0189d4: serviceaccount "payload-processing-e2e-ait-0b0189d4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0b0189d4-78488dcd5b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0b0189d4-78488dcd5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0b0189d4: serviceaccount "payload-processing-e2e-ait-0b0189d4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0b0189d4-78488dcd5b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0b0189d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0b0189d4-78488dcd5b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0b0189d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b0189d4-5cf78db44d-5kl4j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0b0189d4-78488dcd5b-g8sqm

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-67e1471d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-67e1471d

openshift-ingress

deployment-controller

e2e-derive-67e1471d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-67e1471d-openshift-default-6b9485c664 from 0 to 1

openshift-ingress

kubelet

e2e-ait-0b0189d4-openshift-default-66897454b8-4gjr2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-67e1471d-openshift-default-6b9485c664

SuccessfulCreate

Created pod: e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

openshift-ingress

multus

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-67e1471d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-67e1471d-77448b6b98 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-67e1471d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-67e1471d-89f94fdd8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-67e1471d-89f94fdd8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-67e1471d: serviceaccount "payload-processing-e2e-derive-67e1471d" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-67e1471d-77448b6b98

FailedCreate

Error creating: pods "payload-processing-e2e-derive-67e1471d-77448b6b98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-67e1471d: serviceaccount "payload-processing-e2e-derive-67e1471d" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-67e1471d-89f94fdd8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-67e1471d-77448b6b98

SuccessfulCreate

Created pod: payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6

openshift-ingress

multus

payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-67e1471d-77448b6b98-trmp6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-67e1471d-89f94fdd8-2f6zk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-67e1471d-openshift-default-6b9485c664-gmvmn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-mt-eae5981c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-eae5981c-openshift-default-5f7ff77b68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-eae5981c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-eae5981c

openshift-ingress

replicaset-controller

e2e-mt-eae5981c-openshift-default-5f7ff77b68

SuccessfulCreate

Created pod: e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

openshift-ingress

multus

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-eae5981c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-eae5981c-6cf466b844 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-eae5981c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-eae5981c-7f7b8f557d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-eae5981c-6cf466b844

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-eae5981c-6cf466b844-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-eae5981c: serviceaccount "payload-processing-e2e-mt-eae5981c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-eae5981c-7f7b8f557d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-eae5981c-6cf466b844

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-eae5981c-7f7b8f557d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-eae5981c-7f7b8f557d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-eae5981c: serviceaccount "payload-processing-e2e-mt-eae5981c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-eae5981c-7f7b8f557d-t7rbc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-eae5981c-6cf466b844-blsmn

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-eae5981c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-eae5981c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-eae5981c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-eae5981c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5a61b63a-875e-4984-8b60-36bc5b98487d, UID in object meta:

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-eae5981c-openshift-default-5f7ff77b68-m8jn5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

e2e-mt-ef75af22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ef75af22-openshift-default-7dbfd4c4cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb

SuccessfulCreate

Created pod: e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

openshift-ingress

gateway_labeler_controller

e2e-mt-ef75af22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ef75af22

openshift-ingress

multus

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ef75af22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ef75af22-7df5dcc496 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ef75af22-7df5dcc496

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ef75af22: serviceaccount "payload-processing-e2e-mt-ef75af22" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ef75af22-74dddcb8f8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ef75af22-74dddcb8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ef75af22: serviceaccount "payload-processing-e2e-mt-ef75af22" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ef75af22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ef75af22-74dddcb8f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ef75af22-7df5dcc496

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ef75af22-74dddcb8f8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm

openshift-ingress

multus

payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ef75af22-7df5dcc496-lpcrx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ef75af22-74dddcb8f8-b7pcm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-ef75af22-openshift-default-7dbfd4c4cb-jjvvq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-7bbd07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7bbd07

openshift-ingress

deployment-controller

e2e-inf-a-7bbd07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-7bbd07-openshift-default-7b9fff55d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-7bbd07-openshift-default-7b9fff55d

SuccessfulCreate

Created pod: e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

openshift-ingress

multus

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-7bbd07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-7bbd07-f6c756cfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7bbd07: serviceaccount "payload-processing-e2e-inf-a-7bbd07" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-7bbd07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7bbd07-f6c756cfd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7bbd07-f6c756cfd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-7bbd07-f6c756cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7bbd07: serviceaccount "payload-processing-e2e-inf-a-7bbd07" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-4ce65d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-4ce65d-openshift-default-855d54ff58 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-4ce65d-openshift-default-855d54ff58

SuccessfulCreate

Created pod: e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

openshift-ingress

gateway_labeler_controller

e2e-inf-b-4ce65d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-4ce65d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-4ce65d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4ce65d: serviceaccount "payload-processing-e2e-inf-b-4ce65d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-4ce65d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-4ce65d-58ccf665db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4ce65d-58ccf665db

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4ce65d-58ccf665db

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-4ce65d-58ccf665db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4ce65d: serviceaccount "payload-processing-e2e-inf-b-4ce65d" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7bbd07-6c4c5dd96d-th2n9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7bbd07-f6c756cfd-8rcdl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-7bbd07-openshift-default-7b9fff55d-dnr4f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4ce65d-66cdcfd8b4-wxhcw

Unhealthy

Readiness probe failed: dial tcp 10.134.0.40:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4ce65d-58ccf665db-7r76q

Unhealthy

Readiness probe failed: dial tcp 10.134.0.41:9004: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-2eb089-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2eb089-openshift-default-778769f6d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-2eb089-openshift-default-778769f6d8

SuccessfulCreate

Created pod: e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

openshift-ingress

gateway_labeler_controller

e2e-api-a-2eb089

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2eb089

openshift-ingress

multus

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-2eb089-755f998d4-84qgn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2eb089-755f998d4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2eb089-755f998d4-84qgn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2eb089-755f998d4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2eb089-755f998d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2eb089: serviceaccount "payload-processing-e2e-api-a-2eb089" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-2eb089-755f998d4-84qgn

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2eb089

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2eb089-5dffb44f44 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2eb089-5dffb44f44

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2eb089-5dffb44f44

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2eb089: serviceaccount "payload-processing-e2e-api-a-2eb089" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-2eb089-755f998d4-84qgn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-2eb089-755f998d4-84qgn

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2eb089

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2eb089-755f998d4 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-4ce65d-openshift-default-855d54ff58-t28dg

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-api-b-941fec-openshift-default-b7b88ffd6

SuccessfulCreate

Created pod: e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

openshift-ingress

multus

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-941fec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-941fec-openshift-default-b7b88ffd6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-941fec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-941fec

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-941fec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-941fec-58fc7d8db4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-941fec-57db54b78-gq6k5

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-941fec-58fc7d8db4-qs485

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-941fec-58fc7d8db4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-941fec-58fc7d8db4-qs485

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-941fec-57db54b78

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-941fec-57db54b78-gq6k5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-941fec-57db54b78

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-941fec-57db54b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-941fec: serviceaccount "payload-processing-e2e-api-b-941fec" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-941fec-58fc7d8db4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-941fec-58fc7d8db4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-941fec: serviceaccount "payload-processing-e2e-api-b-941fec" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-941fec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-941fec-57db54b78 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-941fec-57db54b78-gq6k5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-941fec-57db54b78-gq6k5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-941fec-57db54b78-gq6k5

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-941fec-58fc7d8db4-qs485

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-941fec-58fc7d8db4-qs485

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-941fec-58fc7d8db4-qs485

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-2eb089

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-2eb089: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-2eb089": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-2eb089, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 683f9efe-e541-4850-9309-121986b0bae2, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-2eb089-755f998d4-84qgn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2eb089-5dffb44f44-4jlpm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-2eb089-openshift-default-778769f6d8-lqxp9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-941fec-57db54b78-gq6k5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-941fec-58fc7d8db4-qs485

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-4289a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-4289a9

openshift-ingress

deployment-controller

e2e-shared-a-4289a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-4289a9-openshift-default-7f556c69b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-4289a9-openshift-default-7f556c69b

SuccessfulCreate

Created pod: e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg

openshift-ingress

multus

e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-941fec-openshift-default-b7b88ffd6-2dq5d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-4289a9-f77767844

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-4289a9-f77767844-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-4289a9: serviceaccount "payload-processing-e2e-shared-a-4289a9" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-4289a9-77cf9558f8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-4289a9-77cf9558f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-4289a9: serviceaccount "payload-processing-e2e-shared-a-4289a9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-4289a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-4289a9-77cf9558f8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-4289a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-4289a9-f77767844 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-4289a9-77cf9558f8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-4289a9-f77767844

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-f99bfd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-f99bfd

openshift-ingress

deployment-controller

e2e-shared-b-f99bfd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-f99bfd-openshift-default-6898796cf6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-f99bfd-openshift-default-6898796cf6

SuccessfulCreate

Created pod: e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

openshift-ingress

multus

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-f99bfd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-f99bfd-c67cbdc94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-f99bfd-c67cbdc94

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-f99bfd-c67cbdc94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-f99bfd: serviceaccount "payload-processing-e2e-shared-b-f99bfd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-f99bfd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-f99bfd: serviceaccount "payload-processing-e2e-shared-b-f99bfd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-f99bfd-c67cbdc94

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-f99bfd-c67cbdc94-zf72r

openshift-ingress

multus

payload-processing-e2e-shared-b-f99bfd-c67cbdc94-zf72r

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-f99bfd-c67cbdc94-zf72r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-f99bfd-c67cbdc94-zf72r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-f99bfd-c67cbdc94-zf72r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-58c998

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-58c998

openshift-ingress

deployment-controller

e2e-ipp-a-58c998-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-58c998-openshift-default-76f5ffd674 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-58c998-openshift-default-76f5ffd674

SuccessfulCreate

Created pod: e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

openshift-ingress

kubelet

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.78s (2.78s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-58c998: serviceaccount "payload-processing-e2e-ipp-a-58c998" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-58c998-65cd5c974b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-58c998-65cd5c974b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-58c998: serviceaccount "payload-processing-e2e-ipp-a-58c998" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-58c998-65cd5c974b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-58c998

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-58c998-65cd5c974b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-58c998

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n

openshift-ingress

multus

payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-b-791fb5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-791fb5-openshift-default-58687ccd56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-791fb5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-791fb5

openshift-ingress

replicaset-controller

e2e-ipp-b-791fb5-openshift-default-58687ccd56

SuccessfulCreate

Created pod: e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

openshift-ingress

multus

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-791fb5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-791fb5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-791fb5-74fb59455b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-791fb5-74fb59455b-zhd6j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-791fb5: serviceaccount "payload-processing-e2e-ipp-b-791fb5" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-791fb5-74fb59455b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-791fb5-74fb59455b-zhd6j
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-791fb5-74fb59455b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-791fb5-74fb59455b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-791fb5: serviceaccount "payload-processing-e2e-ipp-b-791fb5" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-791fb5-74fb59455b-zhd6j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-791fb5-74fb59455b-zhd6j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-791fb5-74fb59455b-zhd6j

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578

SuccessfulCreate

Created pod: e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn

openshift-ingress

deployment-controller

e2e-ipp-cleanup-d8e48b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-d8e48b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-d8e48b

openshift-ingress

multus

e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b: serviceaccount "payload-processing-e2e-ipp-cleanup-d8e48b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d8e48b: serviceaccount "payload-processing-e2e-ipp-cleanup-d8e48b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-d8e48b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88-88hqp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-d8e48b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88-88hqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88-88hqp

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88-88hqp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88-88hqp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d8e48b-55f67f4f88-88hqp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d8e48b-84c58cbc7d-9p7wt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-d8e48b-openshift-default-7d88794578-bbcxn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-58c998-65c8bcfb88-x8d2n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-58c998-65cd5c974b-5988q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-58c998-openshift-default-76f5ffd674-bdz8c

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-791fb5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-791fb5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-791fb5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5f1545a9-267c-41a9-9c33-42a21f00dca5, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-791fb5-577cd7c6d8-bvrck

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-791fb5-74fb59455b-zhd6j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-791fb5-openshift-default-58687ccd56-ndzbn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-4289a9-77cf9558f8-4gj9h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-4289a9-f77767844-2dmkg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-4289a9-openshift-default-7f556c69b-2hxsg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-f99bfd-c67cbdc94-zf72r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-f99bfd-995fdd84d-5vsw4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-f99bfd-openshift-default-6898796cf6-cqqw6

Killing

Stopping container istio-proxy