Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6-m8n6k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6-m8n6k to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4-h92s6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4-h92s6 to ip-10-0-140-5.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcngggp

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcngggp to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs to ip-10-0-140-5.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-mkdsh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-mkdsh to ip-10-0-140-5.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-bljzw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bljzw to ip-10-0-130-142.ec2.internal

openshift-ingress

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7 to ip-10-0-139-46.ec2.internal

openshift-ingress

kube-auth-proxy-84b496c558-987vc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-84b496c558-987vc to ip-10-0-139-46.ec2.internal

openshift-ingress

e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b to ip-10-0-139-46.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-kwr77

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kwr77 to ip-10-0-140-5.ec2.internal

openshift-ingress

kube-auth-proxy-84b496c558-jrfl7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-84b496c558-jrfl7 to ip-10-0-130-142.ec2.internal

openshift-ingress

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr to ip-10-0-139-46.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-j6kgc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-j6kgc to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-vzv9n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-vzv9n to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8630be2b-85fdf95848-vz2sm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8630be2b-85fdf95848-vz2sm to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2 to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj to ip-10-0-130-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6-wghtc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6-wghtc to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0e9e3f-889476-pvtmr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0e9e3f-889476-pvtmr to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8630be2b-58d8db48c6-8mvc4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8630be2b-58d8db48c6-8mvc4 to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6 to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944-bncgl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944-bncgl to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-f6s9j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-f6s9j to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6-mbk95

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6-mbk95 to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9 to ip-10-0-130-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b-x59rh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b-x59rh to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a5726951-openshift-default-64656bbf56-nrg76 to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c to ip-10-0-130-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8 to ip-10-0-130-142.ec2.internal

openshift-ingress

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd-cb2tb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd-cb2tb to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44-dmh9v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44-dmh9v to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h to ip-10-0-140-5.ec2.internal

openshift-ingress

router-default-7fdb95cfb7-czwhl

Scheduled

Successfully assigned openshift-ingress/router-default-7fdb95cfb7-czwhl to ip-10-0-130-142.ec2.internal

openshift-ingress

router-default-7fdb95cfb7-czwhl

FailedScheduling

0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-5cc6cd444b-44t9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-44t9h to ip-10-0-130-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-5c7cfc-6bd84579f8-jrpm8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-5c7cfc-6bd84579f8-jrpm8 to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-bb94b3-649846698b-j69tk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-bb94b3-649846698b-j69tk to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cccec6a6-796f5c7494-g2kzd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cccec6a6-796f5c7494-g2kzd to ip-10-0-140-5.ec2.internal

openshift-ingress

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8 to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a5726951-59cf9b5dc4-xr5fm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a5726951-59cf9b5dc4-xr5fm to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-f431f60c-bfcdfc7df-6jwxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f431f60c-bfcdfc7df-6jwxc to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd-lpvqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd-lpvqr to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk to ip-10-0-130-142.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw to ip-10-0-130-142.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-22bf5f-d6b99694-4wphc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-22bf5f-d6b99694-4wphc to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-387e6e-67db49cf8-47sbs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-387e6e-67db49cf8-47sbs to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3efc9f0f-5b8589fb74-thm9l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3efc9f0f-5b8589fb74-thm9l to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0e9e3f-565485bfc4-nvjnb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0e9e3f-565485bfc4-nvjnb to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-cf30f0-545d44c74d-nmn9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-cf30f0-545d44c74d-nmn9h to ip-10-0-140-5.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e9e1f4e1-5db47c88dd-9hs8w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e9e1f4e1-5db47c88dd-9hs8w to ip-10-0-140-5.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7fdb95cfb7 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-7fdb95cfb7

FailedCreate

Error creating: pods "router-default-7fdb95cfb7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7fdb95cfb7

FailedCreate

Error creating: pods "router-default-7fdb95cfb7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-7fdb95cfb7

SuccessfulCreate

Created pod: router-default-7fdb95cfb7-czwhl
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-7fdb95cfb7-czwhl

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-7fdb95cfb7-czwhl

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-7fdb95cfb7-czwhl

Started

Started container router

openshift-ingress

kubelet

router-default-7fdb95cfb7-czwhl

Created

Created container: router

openshift-ingress

kubelet

router-default-7fdb95cfb7-czwhl

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-7fdb95cfb7-czwhl

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-84b496c558 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-84b496c558-jrfl7

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-84b496c558-jrfl7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-84b496c558

SuccessfulCreate

Created pod: kube-auth-proxy-84b496c558-987vc

openshift-ingress

replicaset-controller

kube-auth-proxy-84b496c558

SuccessfulCreate

Created pod: kube-auth-proxy-84b496c558-jrfl7
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-84b496c558

FailedCreate

Error creating: pods "kube-auth-proxy-84b496c558-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-84b496c558-987vc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-84b496c558-987vc

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-bljzw

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bljzw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-bljzw

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-84b496c558-987vc

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-84b496c558-987vc

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-84b496c558-987vc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.042s (2.042s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bljzw

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-84b496c558-jrfl7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-84b496c558-jrfl7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-84b496c558-jrfl7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.819s (5.819s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bljzw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.513s (4.513s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bljzw

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bljzw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcngggp

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bljzw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngggp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcngggp

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-kwr77

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-kwr77

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kwr77

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-mkdsh

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mkdsh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-mkdsh

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kwr77

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngggp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.776s (5.776s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mkdsh

Created

Created container: discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngggp

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngggp

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kwr77

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.435s (5.435s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kwr77

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mkdsh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.742s (3.742s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mkdsh

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-bljzw

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bljzw

Killing

Stopping container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcngggp

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngggp

ProbeError

Startup probe error: Get "http://10.133.0.17:15021/healthz/ready": dial tcp 10.133.0.17:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngggp

Unhealthy

Startup probe failed: Get "http://10.133.0.17:15021/healthz/ready": dial tcp 10.133.0.17:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngggp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-j6kgc

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-j6kgc

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-44t9h

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-vzv9n
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-vzv9n

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-vzv9n

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-44t9h

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-44t9h

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5cc6cd444b-44t9h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.504s (1.504s including waiting). Image size: 165776054 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-44t9h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-44t9h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-vzv9n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.846s (2.846s including waiting). Image size: 165776054 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-vzv9n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-vzv9n

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j6kgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j6kgc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j6kgc

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j6kgc

ProbeError

Startup probe error: Get "http://10.133.0.20:15021/healthz/ready": dial tcp 10.133.0.20:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j6kgc

Unhealthy

Startup probe failed: Get "http://10.133.0.20:15021/healthz/ready": dial tcp 10.133.0.20:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ait-8630be2b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8630be2b-openshift-default-64b59dcd96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-8630be2b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8630be2b

openshift-ingress

replicaset-controller

e2e-ait-8630be2b-openshift-default-64b59dcd96

SuccessfulCreate

Created pod: e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

openshift-ingress

multus

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8630be2b-58d8db48c6

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8630be2b-58d8db48c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8630be2b: serviceaccount "payload-processing-e2e-ait-8630be2b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8630be2b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8630be2b-58d8db48c6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8630be2b-85fdf95848

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8630be2b-85fdf95848-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8630be2b: serviceaccount "payload-processing-e2e-ait-8630be2b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8630be2b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8630be2b-85fdf95848 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8630be2b-58d8db48c6

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8630be2b-58d8db48c6-8mvc4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8630be2b-85fdf95848

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8630be2b-85fdf95848-vz2sm

openshift-ingress

multus

payload-processing-e2e-ait-8630be2b-58d8db48c6-8mvc4

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8630be2b-58d8db48c6-8mvc4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-8630be2b-58d8db48c6-8mvc4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8630be2b-58d8db48c6-8mvc4

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-8630be2b-85fdf95848-vz2sm

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8630be2b-85fdf95848-vz2sm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8630be2b-85fdf95848-vz2sm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8630be2b-85fdf95848-vz2sm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

Unhealthy

Readiness probe failed: Get "http://10.133.0.28:15021/healthz/ready": read tcp 10.133.0.2:41116->10.133.0.28:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

ProbeError

Readiness probe error: Get "http://10.133.0.28:15021/healthz/ready": read tcp 10.133.0.2:41116->10.133.0.28:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

Created

Created container: istio-proxy
(x3)

openshift-ingress

kubelet

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-8630be2b-58d8db48c6-8mvc4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8630be2b-85fdf95848-vz2sm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-8630be2b-openshift-default-64b59dcd96-qxcpv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-f431f60c-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f431f60c-gw

openshift-ingress

deployment-controller

e2e-migrate-f431f60c-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644

SuccessfulCreate

Created pod: e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

openshift-ingress

multus

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-f431f60c-bfcdfc7df-6jwxc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f431f60c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f431f60c-bfcdfc7df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f431f60c-bfcdfc7df

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f431f60c-bfcdfc7df-6jwxc

openshift-ingress

multus

payload-processing-e2e-migrate-f431f60c-bfcdfc7df-6jwxc

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44-dmh9v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f431f60c: serviceaccount "payload-processing-e2e-migrate-f431f60c" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44-dmh9v

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44-dmh9v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f431f60c-bfcdfc7df

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f431f60c-bfcdfc7df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f431f60c: serviceaccount "payload-processing-e2e-migrate-f431f60c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f431f60c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44-dmh9v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44-dmh9v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f431f60c-bfcdfc7df-6jwxc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f431f60c-bfcdfc7df-6jwxc

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

Unhealthy

Readiness probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

ProbeError

Readiness probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-f431f60c-bfcdfc7df-6jwxc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f431f60c-5467dd5d44-dmh9v

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-e9e1f4e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e9e1f4e1

openshift-ingress

kubelet

e2e-migrate-f431f60c-gw-openshift-default-5bc8fbf644-zr4cr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-e9e1f4e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e9e1f4e1-openshift-default-74798c94cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-e9e1f4e1-openshift-default-74798c94cb

SuccessfulCreate

Created pod: e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

openshift-ingress

multus

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e9e1f4e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e9e1f4e1-5db47c88dd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e9e1f4e1-5db47c88dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e9e1f4e1: serviceaccount "payload-processing-e2e-ait-e9e1f4e1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e9e1f4e1-5db47c88dd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e9e1f4e1-5db47c88dd-9hs8w

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e9e1f4e1: serviceaccount "payload-processing-e2e-ait-e9e1f4e1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e9e1f4e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e9e1f4e1-5db47c88dd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-e9e1f4e1-5db47c88dd-9hs8w

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e9e1f4e1-5db47c88dd-9hs8w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e9e1f4e1-5db47c88dd-9hs8w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e9e1f4e1-5db47c88dd-9hs8w

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

ProbeError

Readiness probe error: Get "http://10.133.0.36:15021/healthz/ready": read tcp 10.133.0.2:53700->10.133.0.36:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

Unhealthy

Readiness probe failed: Get "http://10.133.0.36:15021/healthz/ready": read tcp 10.133.0.2:53700->10.133.0.36:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-e9e1f4e1-5db47c88dd-9hs8w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9e1f4e1-fc8df4bf6-7crlj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-e9e1f4e1-openshift-default-74798c94cb-8vp9t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-3efc9f0f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3efc9f0f-openshift-default-68958f8dd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-3efc9f0f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3efc9f0f

openshift-ingress

replicaset-controller

e2e-derive-3efc9f0f-openshift-default-68958f8dd4

SuccessfulCreate

Created pod: e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h

openshift-ingress

multus

e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3efc9f0f: serviceaccount "payload-processing-e2e-derive-3efc9f0f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3efc9f0f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3efc9f0f-5b8589fb74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3efc9f0f-5b8589fb74

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3efc9f0f-5b8589fb74-thm9l
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3efc9f0f-5b8589fb74

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3efc9f0f-5b8589fb74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3efc9f0f: serviceaccount "payload-processing-e2e-derive-3efc9f0f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3efc9f0f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-3efc9f0f-5b8589fb74-thm9l

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3efc9f0f-5b8589fb74-thm9l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3efc9f0f-5b8589fb74-thm9l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3efc9f0f-5b8589fb74-thm9l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-3efc9f0f-5b8589fb74-thm9l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3efc9f0f-d6bf5f6f6-vzlr9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-3efc9f0f-openshift-default-68958f8dd4-wbr9h

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-cccec6a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cccec6a6-openshift-default-5b796f77b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-cccec6a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cccec6a6

openshift-ingress

replicaset-controller

e2e-mt-cccec6a6-openshift-default-5b796f77b8

SuccessfulCreate

Created pod: e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm

openshift-ingress

multus

e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6-mbk95

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cccec6a6-796f5c7494-g2kzd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cccec6a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cccec6a6-796f5c7494 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cccec6a6-796f5c7494

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cccec6a6-796f5c7494-g2kzd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6-mbk95

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6-mbk95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6-mbk95

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cccec6a6-796f5c7494

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cccec6a6-796f5c7494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cccec6a6: serviceaccount "payload-processing-e2e-mt-cccec6a6" not found

openshift-ingress

multus

payload-processing-e2e-mt-cccec6a6-796f5c7494-g2kzd

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cccec6a6-796f5c7494-g2kzd

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cccec6a6: serviceaccount "payload-processing-e2e-mt-cccec6a6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6-mbk95

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cccec6a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-cccec6a6-796f5c7494-g2kzd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cccec6a6-6c7cc6d6f6-mbk95

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cccec6a6-796f5c7494-g2kzd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-cccec6a6-openshift-default-5b796f77b8-bxsgm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-a5726951-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a5726951-openshift-default-64656bbf56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-a5726951

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a5726951

openshift-ingress

replicaset-controller

e2e-mt-a5726951-openshift-default-64656bbf56

SuccessfulCreate

Created pod: e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

openshift-ingress

multus

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a5726951: serviceaccount "payload-processing-e2e-mt-a5726951" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a5726951

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a5726951

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a5726951-59cf9b5dc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a5726951-59cf9b5dc4

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a5726951-59cf9b5dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a5726951: serviceaccount "payload-processing-e2e-mt-a5726951" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-a5726951-59cf9b5dc4-xr5fm

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a5726951-59cf9b5dc4

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a5726951-59cf9b5dc4-xr5fm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8

openshift-ingress

kubelet

payload-processing-e2e-mt-a5726951-59cf9b5dc4-xr5fm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-a5726951-59cf9b5dc4-xr5fm

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-a5726951-59cf9b5dc4-xr5fm

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5726951-54bf4c4cd4-shxp8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a5726951-59cf9b5dc4-xr5fm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-a5726951-openshift-default-64656bbf56-nrg76

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-inf-a-387e6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-387e6e

openshift-ingress

deployment-controller

e2e-inf-a-387e6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-387e6e-openshift-default-58857fc846 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-387e6e-openshift-default-58857fc846

SuccessfulCreate

Created pod: e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

openshift-ingress

multus

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-387e6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-387e6e-67db49cf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-387e6e-67db49cf8-47sbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-387e6e-67db49cf8-47sbs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b-x59rh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b-x59rh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b-x59rh

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-387e6e-67db49cf8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-387e6e-67db49cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-387e6e: serviceaccount "payload-processing-e2e-inf-a-387e6e" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-387e6e: serviceaccount "payload-processing-e2e-inf-a-387e6e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b-x59rh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-387e6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-387e6e-67db49cf8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-387e6e-67db49cf8-47sbs

openshift-ingress

kubelet

payload-processing-e2e-inf-a-387e6e-67db49cf8-47sbs

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-387e6e-67db49cf8-47sbs

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b-x59rh

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-22bf5f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-22bf5f

openshift-ingress

deployment-controller

e2e-inf-b-22bf5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-22bf5f-openshift-default-9ddc6dc94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-22bf5f-openshift-default-9ddc6dc94

SuccessfulCreate

Created pod: e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh

openshift-ingress

multus

e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-22bf5f: serviceaccount "payload-processing-e2e-inf-b-22bf5f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-22bf5f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-22bf5f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-22bf5f-d6b99694 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-22bf5f-d6b99694

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-22bf5f-d6b99694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-22bf5f: serviceaccount "payload-processing-e2e-inf-b-22bf5f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-22bf5f-d6b99694-4wphc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-22bf5f-d6b99694-4wphc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-22bf5f-d6b99694-4wphc

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-22bf5f-d6b99694

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-22bf5f-d6b99694-4wphc

openshift-ingress

kubelet

payload-processing-e2e-inf-b-22bf5f-d6b99694-4wphc

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-387e6e-67db49cf8-47sbs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-387e6e-6f4895b5b-x59rh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-387e6e-openshift-default-58857fc846-hf6g2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-22bf5f-d6b99694-4wphc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-22bf5f-b5d74d96-9rj7c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-22bf5f-openshift-default-9ddc6dc94-z7fjh

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-cf30f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-cf30f0

openshift-ingress

deployment-controller

e2e-api-a-cf30f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-cf30f0-openshift-default-665f9d488d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-cf30f0-openshift-default-665f9d488d

SuccessfulCreate

Created pod: e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cf30f0-545d44c74d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-cf30f0-545d44c74d-nmn9h
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cf30f0-545d44c74d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-cf30f0-545d44c74d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cf30f0: serviceaccount "payload-processing-e2e-api-a-cf30f0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-cf30f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-cf30f0-545d44c74d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-cf30f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6-wghtc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cf30f0: serviceaccount "payload-processing-e2e-api-a-cf30f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6-wghtc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6-wghtc

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-cf30f0-545d44c74d-nmn9h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6-wghtc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-cf30f0-545d44c74d-nmn9h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-cf30f0-545d44c74d-nmn9h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6-wghtc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-cf30f0-545d44c74d-nmn9h

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-0e9e3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0e9e3f-openshift-default-d795749b6 from 0 to 1

openshift-ingress

multus

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-0e9e3f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0e9e3f

openshift-ingress

replicaset-controller

e2e-api-b-0e9e3f-openshift-default-d795749b6

SuccessfulCreate

Created pod: e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0e9e3f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0e9e3f-565485bfc4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0e9e3f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0e9e3f-889476 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0e9e3f-889476

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0e9e3f-889476-pvtmr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0e9e3f-565485bfc4

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0e9e3f-565485bfc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0e9e3f: serviceaccount "payload-processing-e2e-api-b-0e9e3f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0e9e3f-889476

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0e9e3f-889476-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0e9e3f: serviceaccount "payload-processing-e2e-api-b-0e9e3f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0e9e3f-565485bfc4

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0e9e3f-565485bfc4-nvjnb

openshift-ingress

multus

payload-processing-e2e-api-b-0e9e3f-565485bfc4-nvjnb

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e9e3f-889476-pvtmr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0e9e3f-889476-pvtmr

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e9e3f-889476-pvtmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e9e3f-565485bfc4-nvjnb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e9e3f-565485bfc4-nvjnb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e9e3f-565485bfc4-nvjnb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e9e3f-889476-pvtmr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cf30f0-5d75b74cc6-wghtc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-cf30f0-545d44c74d-nmn9h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-cf30f0-openshift-default-665f9d488d-tfnd8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e9e3f-889476-pvtmr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e9e3f-565485bfc4-nvjnb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-bb94b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-bb94b3

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-0e9e3f-openshift-default-d795749b6-zlzd6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-bb94b3-openshift-default-744f4c755b

SuccessfulCreate

Created pod: e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

openshift-ingress

deployment-controller

e2e-shared-a-bb94b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-bb94b3-openshift-default-744f4c755b from 0 to 1

openshift-ingress

multus

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-bb94b3-649846698b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-bb94b3-649846698b-j69tk

openshift-ingress

multus

payload-processing-e2e-shared-a-bb94b3-649846698b-j69tk

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-bb94b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-bb94b3-649846698b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-f6s9j

openshift-ingress

kubelet

payload-processing-e2e-shared-a-bb94b3-649846698b-j69tk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-bb94b3-649846698b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-bb94b3-649846698b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-bb94b3: serviceaccount "payload-processing-e2e-shared-a-bb94b3" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-bb94b3: serviceaccount "payload-processing-e2e-shared-a-bb94b3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-bb94b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-f6s9j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-f6s9j

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-f6s9j

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-bb94b3-649846698b-j69tk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-f6s9j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-bb94b3-649846698b-j69tk

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-5c7cfc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-5c7cfc

openshift-ingress

replicaset-controller

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8

SuccessfulCreate

Created pod: e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

openshift-ingress

deployment-controller

e2e-shared-b-5c7cfc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-5c7cfc-openshift-default-74f888c8b8 from 0 to 1

openshift-ingress

multus

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-5c7cfc-6bd84579f8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-5c7cfc-6bd84579f8-jrpm8

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944-bncgl

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944-bncgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944-bncgl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944-bncgl

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-5c7cfc: serviceaccount "payload-processing-e2e-shared-b-5c7cfc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-5c7cfc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-5c7cfc-6bd84579f8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-5c7cfc-6bd84579f8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-5c7cfc-6bd84579f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-5c7cfc: serviceaccount "payload-processing-e2e-shared-b-5c7cfc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944-bncgl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-5c7cfc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-5c7cfc-6bd84579f8-jrpm8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-5c7cfc-6bd84579f8-jrpm8

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-5c7cfc-6bd84579f8-jrpm8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-5c7cfc-6bd84579f8-jrpm8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-f6s9j

Unhealthy

Readiness probe failed: dial tcp 10.133.0.66:9004: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-8a6414-openshift-default-65d4b6c74

SuccessfulCreate

Created pod: e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8a6414

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8a6414

openshift-ingress

deployment-controller

e2e-ipp-a-8a6414-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8a6414-openshift-default-65d4b6c74 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.861s (2.861s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8a6414-6c79b679f8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8a6414-6c79b679f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8a6414: serviceaccount "payload-processing-e2e-ipp-a-8a6414" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8a6414-6c79b679f8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8a6414

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6-m8n6k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8a6414: serviceaccount "payload-processing-e2e-ipp-a-8a6414" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8a6414

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8a6414-6c79b679f8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6-m8n6k

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6-m8n6k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6-m8n6k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6-m8n6k

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

ProbeError

Readiness probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

Unhealthy

Readiness probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-bd0742

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-bd0742

openshift-ingress

replicaset-controller

e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8

SuccessfulCreate

Created pod: e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b

openshift-ingress

deployment-controller

e2e-ipp-b-bd0742-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-bd0742

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-bd0742-55dcb8786 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-bd0742-55dcb8786

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-bd0742-55dcb8786

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-bd0742-55dcb8786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-bd0742: serviceaccount "payload-processing-e2e-ipp-b-bd0742" not found
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4-h92s6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-bd0742: serviceaccount "payload-processing-e2e-ipp-b-bd0742" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-bd0742

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4-h92s6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4-h92s6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4-h92s6

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4-h92s6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-ab19c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-ab19c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-ab19c5

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54

SuccessfulCreate

Created pod: e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7

openshift-ingress

multus

e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ab19c5: serviceaccount "payload-processing-e2e-ipp-cleanup-ab19c5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd-cb2tb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-ab19c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-ab19c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd-lpvqr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ab19c5: serviceaccount "payload-processing-e2e-ipp-cleanup-ab19c5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd-cb2tb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd-lpvqr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd-cb2tb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd-cb2tb

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd-cb2tb

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd-lpvqr

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd-lpvqr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd-lpvqr

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ab19c5-d56bbdcdd-cb2tb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ab19c5-6b879847cd-lpvqr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-ab19c5-openshift-default-5877dfdb54-ltnm7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8a6414-8645995fc6-m8n6k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8a6414-6c79b679f8-kggtw

Unhealthy

Readiness probe failed: dial tcp 10.132.0.86:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-8a6414-openshift-default-65d4b6c74-tvnsr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-bd0742-74c49db8d4-h92s6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-bd0742-55dcb8786-lbhhk

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-bd0742

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-bd0742: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-bd0742": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-bd0742, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 55a2bd61-fe09-43f6-b976-59d21e8b6ed9, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-bd0742-openshift-default-6f69cc7bf8-5qv9b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-bb94b3-649846698b-j69tk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-bb94b3-6bbd75db56-f6s9j

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-bb94b3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-bb94b3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-bb94b3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-bb94b3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f416c691-afbe-402d-b64a-29329c2f6d1b, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-bb94b3-openshift-default-744f4c755b-h4v9f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-5c7cfc-6bd84579f8-jrpm8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-5c7cfc-b48bf6944-bncgl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-5c7cfc-openshift-default-74f888c8b8-xv6hs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503