Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-fswzf

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-fswzf to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8 to ip-10-0-128-146.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-twjpn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl to ip-10-0-128-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd to ip-10-0-131-179.ec2.internal

openshift-ingress

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

Scheduled

Successfully assigned openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m to ip-10-0-130-75.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-qfnr9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9 to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj to ip-10-0-131-179.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4 to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl to ip-10-0-130-75.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-54zf6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6 to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4 to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2 to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6 to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh to ip-10-0-131-179.ec2.internal

openshift-ingress

kube-auth-proxy-7d4fcfdb4d-sd6jn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4 to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5 to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd to ip-10-0-131-179.ec2.internal

openshift-ingress

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk to ip-10-0-130-75.ec2.internal

openshift-ingress

kube-auth-proxy-7d4fcfdb4d-krg2z

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d4fcfdb4d-krg2z to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9 to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2 to ip-10-0-131-179.ec2.internal

openshift-ingress

router-default-888465b95-k24rp

Scheduled

Successfully assigned openshift-ingress/router-default-888465b95-k24rp to ip-10-0-128-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf to ip-10-0-131-179.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j to ip-10-0-131-179.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-th7xh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6 to ip-10-0-130-75.ec2.internal

openshift-ingress

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg to ip-10-0-130-75.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx to ip-10-0-131-179.ec2.internal

openshift-ingress

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv to ip-10-0-130-75.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-888465b95 from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-888465b95

FailedCreate

Error creating: pods "router-default-888465b95-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-888465b95

FailedCreate

Error creating: pods "router-default-888465b95-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-888465b95

SuccessfulCreate

Created pod: router-default-888465b95-k24rp
(x6)

openshift-ingress

kubelet

router-default-888465b95-k24rp

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-888465b95-k24rp

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-888465b95-k24rp

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-888465b95-k24rp

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-888465b95-k24rp

Started

Started container router

openshift-ingress

kubelet

router-default-888465b95-k24rp

Created

Created container: router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d4fcfdb4d from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-7d4fcfdb4d

FailedCreate

Error creating: pods "kube-auth-proxy-7d4fcfdb4d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-7d4fcfdb4d-krg2z

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7d4fcfdb4d-sd6jn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-7d4fcfdb4d

SuccessfulCreate

Created pod: kube-auth-proxy-7d4fcfdb4d-sd6jn

openshift-ingress

replicaset-controller

kube-auth-proxy-7d4fcfdb4d

SuccessfulCreate

Created pod: kube-auth-proxy-7d4fcfdb4d-krg2z

openshift-ingress

multus

kube-auth-proxy-7d4fcfdb4d-sd6jn

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7d4fcfdb4d-krg2z

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-th7xh

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-th7xh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-th7xh

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-7d4fcfdb4d-sd6jn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d4fcfdb4d-krg2z

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d4fcfdb4d-krg2z

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d4fcfdb4d-sd6jn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.171s (4.171s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d4fcfdb4d-sd6jn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d4fcfdb4d-krg2z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.45s (3.45s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-th7xh

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-th7xh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.176s (4.176s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-th7xh

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-th7xh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-th7xh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qfnr9

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-qfnr9

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qfnr9

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qfnr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-qfnr9

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-th7xh

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-th7xh

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.17s (3.17s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-th7xh

Unhealthy

Readiness probe failed: Get "http://10.134.0.28:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-th7xh

ProbeError

Readiness probe error: Get "http://10.134.0.28:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-54zf6

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-54zf6

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5cc6cd444b-fswzf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-fswzf
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5cc6cd444b-fswzf

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-twjpn

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-twjpn

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-twjpn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-twjpn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-fswzf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.241s (2.241s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-twjpn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.461s (2.461s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-twjpn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-fswzf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-fswzf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-54zf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-54zf6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-54zf6

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-54zf6

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-54zf6

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ait-a3cc1f19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a3cc1f19-openshift-default-7c58ddcf98 from 0 to 1

openshift-ingress

multus

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98

SuccessfulCreate

Created pod: e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

openshift-ingress

gateway_labeler_controller

e2e-ait-a3cc1f19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a3cc1f19
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a3cc1f19-6b9799dc4b

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a3cc1f19: serviceaccount "payload-processing-e2e-ait-a3cc1f19" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a3cc1f19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a3cc1f19: serviceaccount "payload-processing-e2e-ait-a3cc1f19" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a3cc1f19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a3cc1f19-6b9799dc4b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a3cc1f19-6b9799dc4b

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh

openshift-ingress

multus

payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": read tcp 10.134.0.2:35074->10.134.0.54:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": read tcp 10.134.0.2:35074->10.134.0.54:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-a3cc1f19

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-a3cc1f19": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b22827ac-d9da-4cc8-8504-d2bacee5539c, UID in object meta:

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-4daf5ef5-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4daf5ef5-gw

openshift-ingress

deployment-controller

e2e-migrate-4daf5ef5-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd

SuccessfulCreate

Created pod: e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

openshift-ingress

multus

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4daf5ef5-58d8fcd877

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4daf5ef5: serviceaccount "payload-processing-e2e-migrate-4daf5ef5" not found

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4daf5ef5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4daf5ef5-58d8fcd877 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4daf5ef5-58d8fcd877

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4daf5ef5: serviceaccount "payload-processing-e2e-migrate-4daf5ef5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4daf5ef5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.544s (2.544s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-4daf5ef5-58d8fcd877-cs5j9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-237c0540

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-237c0540

openshift-ingress

deployment-controller

e2e-ait-237c0540-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-237c0540-openshift-default-78648d5848 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-237c0540-openshift-default-78648d5848

SuccessfulCreate

Created pod: e2e-ait-237c0540-openshift-default-78648d5848-cht7m

openshift-ingress

multus

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-237c0540-69dfdf9cd4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-237c0540-7dc49c98d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-237c0540: serviceaccount "payload-processing-e2e-ait-237c0540" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-237c0540-69dfdf9cd4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-237c0540-69dfdf9cd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-237c0540: serviceaccount "payload-processing-e2e-ait-237c0540" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-237c0540

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-237c0540-69dfdf9cd4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-237c0540

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-237c0540-7dc49c98d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-237c0540-7dc49c98d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-237c0540-69dfdf9cd4-pbtrj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-237c0540-7dc49c98d4-5j7lx

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-derive-f9b729be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f9b729be-openshift-default-694b97cfbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-f9b729be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f9b729be

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-f9b729be-openshift-default-694b97cfbd

SuccessfulCreate

Created pod: e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

openshift-ingress

multus

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-237c0540-openshift-default-78648d5848-cht7m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f9b729be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f9b729be-9546ccf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f9b729be-9546ccf8

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f9b729be-9546ccf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f9b729be: serviceaccount "payload-processing-e2e-derive-f9b729be" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f9b729be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f9b729be-565c57b464 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f9b729be-565c57b464

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f9b729be-565c57b464-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f9b729be: serviceaccount "payload-processing-e2e-derive-f9b729be" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f9b729be-9546ccf8

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f9b729be-565c57b464

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd

openshift-ingress

kubelet

payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f9b729be-565c57b464-pk6vd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f9b729be-9546ccf8-lrbwm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-51353e63

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-51353e63

openshift-ingress

deployment-controller

e2e-mt-51353e63-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-51353e63-openshift-default-5f9fd87fd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-51353e63-openshift-default-5f9fd87fd4

SuccessfulCreate

Created pod: e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

openshift-ingress

multus

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-51353e63

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-51353e63-58db9969d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-51353e63-55c95f8f94

SuccessfulCreate

Created pod: payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-51353e63-55c95f8f94

FailedCreate

Error creating: pods "payload-processing-e2e-mt-51353e63-55c95f8f94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-51353e63: serviceaccount "payload-processing-e2e-mt-51353e63" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-51353e63

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-51353e63-55c95f8f94 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-51353e63-58db9969d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-51353e63-58db9969d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-51353e63: serviceaccount "payload-processing-e2e-mt-51353e63" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-51353e63-58db9969d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx

openshift-ingress

kubelet

payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": read tcp 10.134.0.2:54514->10.134.0.61:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": read tcp 10.134.0.2:54514->10.134.0.61:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-51353e63-55c95f8f94-fwkvf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-51353e63-58db9969d8-8jrgx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-mt-2c013e89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2c013e89-openshift-default-7c9bfc9f6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d

SuccessfulCreate

Created pod: e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

openshift-ingress

gateway_labeler_controller

e2e-mt-2c013e89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2c013e89

openshift-ingress

multus

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2c013e89-5569dd7458

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2c013e89-5569dd7458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2c013e89: serviceaccount "payload-processing-e2e-mt-2c013e89" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2c013e89-766c5bc79b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2c013e89: serviceaccount "payload-processing-e2e-mt-2c013e89" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2c013e89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2c013e89-766c5bc79b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2c013e89-5569dd7458

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2c013e89-766c5bc79b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2c013e89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2c013e89-5569dd7458 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-2c013e89-5569dd7458-dwj7j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2c013e89-766c5bc79b-mcbgk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-inf-a-98c9c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-98c9c7-openshift-default-6b764dd568 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-98c9c7-openshift-default-6b764dd568

SuccessfulCreate

Created pod: e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

openshift-ingress

gateway_labeler_controller

e2e-inf-a-98c9c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-98c9c7

openshift-ingress

multus

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-98c9c7: serviceaccount "payload-processing-e2e-inf-a-98c9c7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-98c9c7-7f66bcb644

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-98c9c7-7f66bcb644-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-98c9c7: serviceaccount "payload-processing-e2e-inf-a-98c9c7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-98c9c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-98c9c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-98c9c7-7f66bcb644 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-98c9c7-7f66bcb644

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb

openshift-ingress

kubelet

payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-fde6bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-fde6bc

openshift-ingress

deployment-controller

e2e-inf-b-fde6bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-fde6bc-openshift-default-5c4b994464 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-fde6bc

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-fde6bc-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-fde6bc-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-inf-b-fde6bc-openshift-default-5c4b994464

SuccessfulCreate

Created pod: e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

openshift-ingress

multus

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-fde6bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-fde6bc-8bdb98868 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fde6bc: serviceaccount "payload-processing-e2e-inf-b-fde6bc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-fde6bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fde6bc-8bdb98868

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-fde6bc-8bdb98868-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fde6bc: serviceaccount "payload-processing-e2e-inf-b-fde6bc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fde6bc-8bdb98868

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz

Unhealthy

Readiness probe failed: dial tcp 10.133.0.66:9004: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-98c9c7-85c69fb596-lw8p6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-98c9c7-7f66bcb644-gcdsb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fde6bc-8bdb98868-jh2hd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fde6bc-855fcf5bcb-lwmrz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-b89f96-openshift-default-86759d5db4

SuccessfulCreate

Created pod: e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

openshift-ingress

deployment-controller

e2e-api-a-b89f96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b89f96-openshift-default-86759d5db4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-b89f96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b89f96

openshift-ingress

multus

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b89f96-5b699b4bb8

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2

openshift-ingress

multus

payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b89f96-5b699b4bb8

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b89f96-5b699b4bb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b89f96: serviceaccount "payload-processing-e2e-api-a-b89f96" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b89f96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b89f96-5b699b4bb8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b89f96-5ffc774f88

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b89f96: serviceaccount "payload-processing-e2e-api-a-b89f96" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b89f96-5ffc774f88

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b89f96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b89f96-5ffc774f88 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": read tcp 10.134.0.2:47122->10.134.0.66:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": read tcp 10.134.0.2:47122->10.134.0.66:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-220161

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-220161

openshift-ingress

multus

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-220161-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-220161-openshift-default-5bf996c57d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-220161-openshift-default-5bf996c57d

SuccessfulCreate

Created pod: e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-220161

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-220161-76c756f5b8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-220161-5b6b856d7d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-220161-76c756f5b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w

openshift-ingress

kubelet

payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-220161-5b6b856d7d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-220161-5b6b856d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-220161: serviceaccount "payload-processing-e2e-api-b-220161" not found

openshift-ingress

multus

payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-220161

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-220161-5b6b856d7d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-220161-76c756f5b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-220161-76c756f5b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-220161: serviceaccount "payload-processing-e2e-api-b-220161" not found

openshift-ingress

kubelet

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-b89f96-5b699b4bb8-k58d2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b89f96-5ffc774f88-884dl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-220161-5b6b856d7d-4ssvh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-220161-76c756f5b8-zqp7w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-b75946-openshift-default-7ddbc54776

SuccessfulCreate

Created pod: e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

openshift-ingress

gateway_labeler_controller

e2e-shared-a-b75946

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-b75946

openshift-ingress

deployment-controller

e2e-shared-a-b75946-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-b75946-openshift-default-7ddbc54776 from 0 to 1

openshift-ingress

multus

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-b75946-748f4d48b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-b75946-748f4d48b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-b75946: serviceaccount "payload-processing-e2e-shared-a-b75946" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-b75946

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-b75946-748f4d48b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-b75946

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-b75946-748f4d48b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-b75946: serviceaccount "payload-processing-e2e-shared-a-b75946" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": read tcp 10.134.0.2:41604->10.134.0.68:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": read tcp 10.134.0.2:41604->10.134.0.68:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-bdf164-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-bdf164-openshift-default-7c4d6cfd88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-bdf164

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-bdf164

openshift-ingress

replicaset-controller

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88

SuccessfulCreate

Created pod: e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

openshift-ingress

multus

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-bdf164

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-bdf164-5b54f75fd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-bdf164

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-bdf164: serviceaccount "payload-processing-e2e-shared-b-bdf164" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-bdf164-5b54f75fd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-bdf164-5b54f75fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-bdf164: serviceaccount "payload-processing-e2e-shared-b-bdf164" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-bdf164-5b54f75fd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b

openshift-ingress

kubelet

payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-78eb1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-78eb1c

openshift-ingress

replicaset-controller

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d

SuccessfulCreate

Created pod: e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

openshift-ingress

deployment-controller

e2e-ipp-a-78eb1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-78eb1c-openshift-default-7464f4c85d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.223s (3.223s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-78eb1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-78eb1c: serviceaccount "payload-processing-e2e-ipp-a-78eb1c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-78eb1c-58c84ff67d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-78eb1c: serviceaccount "payload-processing-e2e-ipp-a-78eb1c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-78eb1c-58c84ff67d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-78eb1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-78eb1c-58c84ff67d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2aadf4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2aadf4

openshift-ingress

replicaset-controller

e2e-ipp-b-2aadf4-openshift-default-576c5776f6

SuccessfulCreate

Created pod: e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8

openshift-ingress

multus

e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-2aadf4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2aadf4-openshift-default-576c5776f6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2aadf4: serviceaccount "payload-processing-e2e-ipp-b-2aadf4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2aadf4: serviceaccount "payload-processing-e2e-ipp-b-2aadf4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2aadf4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2aadf4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4

openshift-ingress

deployment-controller

e2e-ipp-cleanup-8cd2f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-cleanup-8cd2f5

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-cleanup-8cd2f5-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-cleanup-8cd2f5-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-8cd2f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-8cd2f5

openshift-ingress

multus

e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5: serviceaccount "payload-processing-e2e-ipp-cleanup-8cd2f5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8cd2f5: serviceaccount "payload-processing-e2e-ipp-cleanup-8cd2f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-8cd2f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-8cd2f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8cd2f5-6d8574d7d8-w95lg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8cd2f5-f64b4c756-7m7hd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-78eb1c-58c84ff67d-vvrjh

Unhealthy

Readiness probe failed: dial tcp 10.133.0.90:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-78eb1c-openshift-default-7464f4c85d-mtvtl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-2aadf4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-2aadf4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b0d61af8-9907-44ae-b790-76388b391d9f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-2aadf4-openshift-default-576c5776f6-bkkm8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b75946-67cfccb9bd-czrg2

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-b75946

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-b75946: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-b75946": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-b75946, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 54c822af-4fba-4f85-b494-9f4752abeb46, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b75946-748f4d48b-b6j8c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-bdf164-689d95b8d8-4gx7k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-bdf164-5b54f75fd-xpj4b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: