Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-b-449ecf-6574556f74-fvmgh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-449ecf-6574556f74-fvmgh to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-787669-7d684595bd-5jhjr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-787669-7d684595bd-5jhjr to ip-10-0-136-110.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bck4pck

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck to ip-10-0-132-198.ec2.internal

openshift-ingress

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq to ip-10-0-132-198.ec2.internal

openshift-ingress

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t to ip-10-0-132-198.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-x6wb8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8 to ip-10-0-132-198.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vtc6n

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vtc6n to ip-10-0-129-245.ec2.internal

openshift-ingress

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d to ip-10-0-129-245.ec2.internal

openshift-ingress

e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp to ip-10-0-132-198.ec2.internal

openshift-ingress

kube-auth-proxy-68fdc99b6-nrz9s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-68fdc99b6-nrz9s to ip-10-0-136-110.ec2.internal

openshift-ingress

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n to ip-10-0-132-198.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c to ip-10-0-129-245.ec2.internal

openshift-ingress

kube-auth-proxy-68fdc99b6-zff46

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-68fdc99b6-zff46 to ip-10-0-129-245.ec2.internal

openshift-ingress

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg to ip-10-0-132-198.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-kpw6c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-kpw6c to ip-10-0-129-245.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8c1aeab3-5df9b45584-lv6zt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8c1aeab3-5df9b45584-lv6zt to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-hw7pp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-hw7pp to ip-10-0-129-245.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4-csjkz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4-csjkz to ip-10-0-129-245.ec2.internal

openshift-ingress

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw to ip-10-0-129-245.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68-lbs6b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68-lbs6b to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-678134-678bf54484-bs9n6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-678134-678bf54484-bs9n6 to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-1ae1a9-b46754584-7khj7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1ae1a9-b46754584-7khj7 to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96-59rcl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96-59rcl to ip-10-0-136-110.ec2.internal

openshift-ingress

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j to ip-10-0-132-198.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4-c26s2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4-c26s2 to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-g72sw

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-g72sw to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-449ecf-d57df55cb-hf5xw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-449ecf-d57df55cb-hf5xw to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-e2e-ait-bd4a88b3-5489cfb6c6-dfvhr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-bd4a88b3-5489cfb6c6-dfvhr to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-678134-744dc4bfd-xkm7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-678134-744dc4bfd-xkm7f to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-1ae1a9-7cf7894cb6-jnvff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1ae1a9-7cf7894cb6-jnvff to ip-10-0-136-110.ec2.internal

openshift-ingress

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96 to ip-10-0-129-245.ec2.internal

openshift-ingress

payload-processing-e2e-derive-2c1cd65e-744dfcd494-9bsvs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2c1cd65e-744dfcd494-9bsvs to ip-10-0-136-110.ec2.internal

openshift-ingress

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c to ip-10-0-132-198.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6-27kc5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6-27kc5 to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8-pb7md

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8-pb7md to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5df102-6d9586d64-7d8c8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5df102-6d9586d64-7d8c8 to ip-10-0-136-110.ec2.internal

openshift-ingress

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k to ip-10-0-132-198.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6-5f4nk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6-5f4nk to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-42b8f369-675b4b6988-h9jbl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-42b8f369-675b4b6988-h9jbl to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-760f3539-6f5dbd7648-64hcj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-760f3539-6f5dbd7648-64hcj to ip-10-0-129-245.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a3b50177-7d8cb9464-2nmzc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a3b50177-7d8cb9464-2nmzc to ip-10-0-136-110.ec2.internal

openshift-ingress

e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g to ip-10-0-129-245.ec2.internal

openshift-ingress

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz to ip-10-0-129-245.ec2.internal

openshift-ingress

router-default-7fffc66b69-rfwq8

Scheduled

Successfully assigned openshift-ingress/router-default-7fffc66b69-rfwq8 to ip-10-0-132-198.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696-z5smz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696-z5smz to ip-10-0-136-110.ec2.internal

openshift-ingress

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw to ip-10-0-132-198.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4-v7dm5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4-v7dm5 to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a3b50177-b798b56fd-d2hdx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a3b50177-b798b56fd-d2hdx to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-e2e-mt-760f3539-55cdc44df8-4c8zk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-760f3539-55cdc44df8-4c8zk to ip-10-0-136-110.ec2.internal

openshift-ingress

e2e-api-a-678134-openshift-default-b757565f8-v5j82

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-678134-openshift-default-b757565f8-v5j82 to ip-10-0-129-245.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-42b8f369-868457b7d5-p5q79

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-42b8f369-868457b7d5-p5q79 to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4-x9hb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4-x9hb8 to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-5df102-6748fdddcb-xpwxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5df102-6748fdddcb-xpwxm to ip-10-0-136-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-787669-856dd6bf68-mmwcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-787669-856dd6bf68-mmwcr to ip-10-0-129-245.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-55d9b1-8447fd9d48-lsf2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-55d9b1-8447fd9d48-lsf2n to ip-10-0-129-245.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7fffc66b69 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-7fffc66b69

FailedCreate

Error creating: pods "router-default-7fffc66b69-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7fffc66b69

FailedCreate

Error creating: pods "router-default-7fffc66b69-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7fffc66b69

SuccessfulCreate

Created pod: router-default-7fffc66b69-rfwq8
(x6)

openshift-ingress

kubelet

router-default-7fffc66b69-rfwq8

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7fffc66b69-rfwq8

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7fffc66b69-rfwq8

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-7fffc66b69-rfwq8

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7fffc66b69-rfwq8

Started

Started container router

openshift-ingress

kubelet

router-default-7fffc66b69-rfwq8

Created

Created container: router

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-nrz9s

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-68fdc99b6 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-68fdc99b6

SuccessfulCreate

Created pod: kube-auth-proxy-68fdc99b6-nrz9s

openshift-ingress

replicaset-controller

kube-auth-proxy-68fdc99b6

SuccessfulCreate

Created pod: kube-auth-proxy-68fdc99b6-zff46
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-68fdc99b6

FailedCreate

Error creating: pods "kube-auth-proxy-68fdc99b6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-zff46

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-68fdc99b6-nrz9s

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-nrz9s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vtc6n

openshift-ingress

multus

kube-auth-proxy-68fdc99b6-zff46

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-zff46

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vtc6n

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtc6n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-nrz9s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.322s (2.322s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-nrz9s

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-nrz9s

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtc6n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.248s (4.248s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-zff46

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-zff46

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-68fdc99b6-zff46

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.204s (5.204s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtc6n

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtc6n

Started

Started container discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bck4pck

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtc6n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtc6n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-x6wb8

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x6wb8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-x6wb8

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bck4pck

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bck4pck

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.486s (2.486s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c

Unhealthy

Startup probe failed: Get "http://10.133.0.19:15021/healthz/ready": dial tcp 10.133.0.19:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-s6w4c

ProbeError

Startup probe error: Get "http://10.133.0.19:15021/healthz/ready": dial tcp 10.133.0.19:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bck4pck

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bck4pck

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bck4pck

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.027s (4.027s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x6wb8

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x6wb8

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x6wb8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.88s (3.88s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x6wb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bck4pck

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-x6wb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bck4pck

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bck4pck

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bck4pck

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vtc6n

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtc6n

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-kpw6c

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-kpw6c
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-g72sw

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-hw7pp

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-hw7pp

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-hw7pp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-g72sw

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-g72sw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5cc6cd444b-g72sw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-g72sw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-g72sw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.517s (1.517s including waiting). Image size: 165776054 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-hw7pp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.351s (3.351s including waiting). Image size: 165776054 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-hw7pp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-hw7pp

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kpw6c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kpw6c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kpw6c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kpw6c

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-kpw6c

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-8c1aeab3-openshift-default-6cb87f6776

SuccessfulCreate

Created pod: e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

openshift-ingress

multus

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-8c1aeab3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8c1aeab3-openshift-default-6cb87f6776 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-8c1aeab3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8c1aeab3

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4-csjkz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8c1aeab3: serviceaccount "payload-processing-e2e-ait-8c1aeab3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8c1aeab3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8c1aeab3-5df9b45584

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8c1aeab3-5df9b45584-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8c1aeab3: serviceaccount "payload-processing-e2e-ait-8c1aeab3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8c1aeab3-5df9b45584

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8c1aeab3-5df9b45584-lv6zt

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8c1aeab3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8c1aeab3-5df9b45584 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-8c1aeab3-5df9b45584-lv6zt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8c1aeab3-5df9b45584-lv6zt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-8c1aeab3-5df9b45584-lv6zt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4-csjkz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-8c1aeab3-5df9b45584-lv6zt

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4-csjkz

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4-csjkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4-csjkz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-8c1aeab3-5df9b45584-lv6zt

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-8c1aeab3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-8c1aeab3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-8c1aeab3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-8c1aeab3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0d8b6fb1-52e6-47ab-b56f-0e8ba71efb1d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8c1aeab3-7678b4d8d4-csjkz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-42b8f369-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-42b8f369-gw-openshift-default-658dd45596 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-42b8f369-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-42b8f369-gw

openshift-ingress

replicaset-controller

e2e-migrate-42b8f369-gw-openshift-default-658dd45596

SuccessfulCreate

Created pod: e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

openshift-ingress

multus

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-42b8f369-868457b7d5-p5q79

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-42b8f369

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-42b8f369-675b4b6988 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-42b8f369

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-42b8f369-868457b7d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-42b8f369-675b4b6988

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-42b8f369-675b4b6988-h9jbl

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-42b8f369-868457b7d5

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-42b8f369-868457b7d5-p5q79
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-42b8f369-868457b7d5

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-42b8f369-868457b7d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-42b8f369: serviceaccount "payload-processing-e2e-migrate-42b8f369" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-42b8f369-675b4b6988

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-42b8f369-675b4b6988-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-42b8f369: serviceaccount "payload-processing-e2e-migrate-42b8f369" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-42b8f369-868457b7d5-p5q79

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-42b8f369-675b4b6988-h9jbl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-42b8f369-868457b7d5-p5q79

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-42b8f369-675b4b6988-h9jbl

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-42b8f369-675b4b6988-h9jbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-42b8f369-868457b7d5-p5q79

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-42b8f369-675b4b6988-h9jbl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-42b8f369-675b4b6988-h9jbl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-42b8f369-868457b7d5-p5q79

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-42b8f369-gw-openshift-default-658dd45596-ccp9d

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-bd4a88b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-bd4a88b3

openshift-ingress

replicaset-controller

e2e-ait-bd4a88b3-openshift-default-6b94f9d848

SuccessfulCreate

Created pod: e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

openshift-ingress

deployment-controller

e2e-ait-bd4a88b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-bd4a88b3-openshift-default-6b94f9d848 from 0 to 1

openshift-ingress

multus

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-bd4a88b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bd4a88b3: serviceaccount "payload-processing-e2e-ait-bd4a88b3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bd4a88b3-5489cfb6c6

FailedCreate

Error creating: pods "payload-processing-e2e-ait-bd4a88b3-5489cfb6c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bd4a88b3: serviceaccount "payload-processing-e2e-ait-bd4a88b3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-bd4a88b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-bd4a88b3-5489cfb6c6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68-lbs6b

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68-lbs6b

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68-lbs6b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68-lbs6b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68-lbs6b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-bd4a88b3-5489cfb6c6-dfvhr

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-bd4a88b3-5489cfb6c6-dfvhr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-bd4a88b3-5489cfb6c6-dfvhr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bd4a88b3-5489cfb6c6-dfvhr

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bd4a88b3-5489cfb6c6

SuccessfulCreate

Created pod: payload-processing-e2e-ait-bd4a88b3-5489cfb6c6-dfvhr
(x2)

openshift-ingress

kubelet

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-bd4a88b3-5489cfb6c6-dfvhr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd4a88b3-c8c587d68-lbs6b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-2c1cd65e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2c1cd65e

openshift-ingress

deployment-controller

e2e-derive-2c1cd65e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2c1cd65e-openshift-default-5b8bf76488 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-2c1cd65e-openshift-default-5b8bf76488

SuccessfulCreate

Created pod: e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2c1cd65e-744dfcd494

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2c1cd65e-744dfcd494-9bsvs

openshift-ingress

multus

payload-processing-e2e-derive-2c1cd65e-744dfcd494-9bsvs

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96-59rcl

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2c1cd65e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2c1cd65e-744dfcd494 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96-59rcl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2c1cd65e-744dfcd494

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2c1cd65e-744dfcd494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2c1cd65e: serviceaccount "payload-processing-e2e-derive-2c1cd65e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2c1cd65e: serviceaccount "payload-processing-e2e-derive-2c1cd65e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96-59rcl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2c1cd65e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-2c1cd65e-744dfcd494-9bsvs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96-59rcl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96-59rcl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2c1cd65e-744dfcd494-9bsvs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2c1cd65e-744dfcd494-9bsvs

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-2c1cd65e-744dfcd494-9bsvs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c1cd65e-646b4bdf96-59rcl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-2c1cd65e-openshift-default-5b8bf76488-bnqkz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-a3b50177-openshift-default-85f4754c6d

SuccessfulCreate

Created pod: e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g

openshift-ingress

deployment-controller

e2e-mt-a3b50177-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a3b50177-openshift-default-85f4754c6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-a3b50177

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a3b50177

openshift-ingress

multus

e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a3b50177

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a3b50177-7d8cb9464 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a3b50177-7d8cb9464

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a3b50177-7d8cb9464-2nmzc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a3b50177-b798b56fd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a3b50177-b798b56fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a3b50177: serviceaccount "payload-processing-e2e-mt-a3b50177" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a3b50177-7d8cb9464

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a3b50177-7d8cb9464-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a3b50177: serviceaccount "payload-processing-e2e-mt-a3b50177" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a3b50177

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a3b50177-b798b56fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-a3b50177-b798b56fd-d2hdx

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-a3b50177-7d8cb9464-2nmzc

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-a3b50177-b798b56fd-d2hdx

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-a3b50177-b798b56fd-d2hdx

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a3b50177-7d8cb9464-2nmzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a3b50177-b798b56fd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a3b50177-b798b56fd-d2hdx

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a3b50177-7d8cb9464-2nmzc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a3b50177-b798b56fd-d2hdx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a3b50177-7d8cb9464-2nmzc

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-a3b50177

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-a3b50177: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-a3b50177": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-a3b50177, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 241de9d9-dbc6-4a2a-abf8-4c2837022289, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a3b50177-7d8cb9464-2nmzc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a3b50177-b798b56fd-d2hdx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-a3b50177-openshift-default-85f4754c6d-sp46g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-760f3539-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-760f3539-openshift-default-7f7b59b8d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-760f3539

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-760f3539

openshift-ingress

replicaset-controller

e2e-mt-760f3539-openshift-default-7f7b59b8d4

SuccessfulCreate

Created pod: e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

openshift-ingress

multus

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-760f3539-6f5dbd7648

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-760f3539-6f5dbd7648-64hcj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-760f3539-6f5dbd7648

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-760f3539-6f5dbd7648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-760f3539: serviceaccount "payload-processing-e2e-mt-760f3539" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-760f3539-55cdc44df8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-760f3539-55cdc44df8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-760f3539: serviceaccount "payload-processing-e2e-mt-760f3539" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-760f3539-55cdc44df8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-760f3539-55cdc44df8-4c8zk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-760f3539

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-760f3539-6f5dbd7648 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-760f3539

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-760f3539-55cdc44df8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-760f3539-6f5dbd7648-64hcj

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-760f3539-55cdc44df8-4c8zk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-760f3539-6f5dbd7648-64hcj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-760f3539-6f5dbd7648-64hcj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-760f3539-6f5dbd7648-64hcj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-760f3539-55cdc44df8-4c8zk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-760f3539-55cdc44df8-4c8zk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-760f3539-55cdc44df8-4c8zk

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-760f3539-55cdc44df8-4c8zk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-760f3539-6f5dbd7648-64hcj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-c97e06

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-c97e06

openshift-ingress

deployment-controller

e2e-inf-a-c97e06-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-c97e06-openshift-default-57c7f87986 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-c97e06-openshift-default-57c7f87986

SuccessfulCreate

Created pod: e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

openshift-ingress

multus

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c97e06: serviceaccount "payload-processing-e2e-inf-a-c97e06" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-c97e06

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-c97e06

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c97e06: serviceaccount "payload-processing-e2e-inf-a-c97e06" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8-pb7md

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8-pb7md

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4-c26s2

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4-c26s2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8-pb7md

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8-pb7md

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4-c26s2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4-c26s2

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4-c26s2

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8-pb7md

openshift-ingress

deployment-controller

e2e-inf-b-55d9b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-55d9b1-openshift-default-6944f8dc5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-55d9b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-55d9b1

openshift-ingress

replicaset-controller

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b

SuccessfulCreate

Created pod: e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

openshift-ingress

multus

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-55d9b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-55d9b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-55d9b1-8447fd9d48 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6-27kc5

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-55d9b1-8447fd9d48

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-55d9b1-8447fd9d48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-55d9b1: serviceaccount "payload-processing-e2e-inf-b-55d9b1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-55d9b1-8447fd9d48

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-55d9b1-8447fd9d48-lsf2n

openshift-ingress

kubelet

payload-processing-e2e-inf-b-55d9b1-8447fd9d48-lsf2n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-55d9b1-8447fd9d48-lsf2n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-55d9b1-8447fd9d48-lsf2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6-27kc5

openshift-ingress

multus

payload-processing-e2e-inf-b-55d9b1-8447fd9d48-lsf2n

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-55d9b1: serviceaccount "payload-processing-e2e-inf-b-55d9b1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6-27kc5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6-27kc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6-27kc5

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c97e06-5bdbf5bcf8-pb7md

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c97e06-697dfc8dd4-c26s2

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-c97e06

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-c97e06: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-c97e06": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-c97e06, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 474059b4-ea50-4e21-8803-e2c372a1d6c2, UID in object meta:

openshift-ingress

kubelet

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-c97e06-openshift-default-57c7f87986-nthjw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-55d9b1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-55d9b1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-55d9b1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-55d9b1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6f9c6509-5fcd-4f99-9d94-75597dcf7f5c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-55d9b1-6d49566ff6-27kc5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-55d9b1-8447fd9d48-lsf2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-678134-openshift-default-b757565f8

SuccessfulCreate

Created pod: e2e-api-a-678134-openshift-default-b757565f8-v5j82

openshift-ingress

deployment-controller

e2e-api-a-678134-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-678134-openshift-default-b757565f8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-678134

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-678134

openshift-ingress

multus

e2e-api-a-678134-openshift-default-b757565f8-v5j82

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-678134-678bf54484

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-678134-678bf54484-bs9n6

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-678134

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-678134-744dc4bfd from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-678134-744dc4bfd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-678134-744dc4bfd-xkm7f
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-678134-678bf54484

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-678134-678bf54484-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-678134: serviceaccount "payload-processing-e2e-api-a-678134" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-678134

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-678134-678bf54484 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-678134-744dc4bfd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-678134-744dc4bfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-678134: serviceaccount "payload-processing-e2e-api-a-678134" not found

openshift-ingress

multus

payload-processing-e2e-api-a-678134-744dc4bfd-xkm7f

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-678134-678bf54484-bs9n6

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-678134-744dc4bfd-xkm7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-678134-678bf54484-bs9n6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-678134-678bf54484-bs9n6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-678134-744dc4bfd-xkm7f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-678134-678bf54484-bs9n6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-678134-744dc4bfd-xkm7f

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-api-b-1ae1a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-1ae1a9-openshift-default-8499f77dfd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-1ae1a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1ae1a9

openshift-ingress

multus

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-1ae1a9-openshift-default-8499f77dfd

SuccessfulCreate

Created pod: e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1ae1a9-7cf7894cb6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-1ae1a9-7cf7894cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1ae1a9: serviceaccount "payload-processing-e2e-api-b-1ae1a9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-1ae1a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-1ae1a9-7cf7894cb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1ae1a9-b46754584

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-1ae1a9-b46754584-7khj7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1ae1a9-b46754584

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-1ae1a9-b46754584-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1ae1a9: serviceaccount "payload-processing-e2e-api-b-1ae1a9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-1ae1a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-1ae1a9-b46754584 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1ae1a9-7cf7894cb6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-1ae1a9-7cf7894cb6-jnvff

openshift-ingress

multus

payload-processing-e2e-api-b-1ae1a9-7cf7894cb6-jnvff

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-1ae1a9-7cf7894cb6-jnvff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1ae1a9-b46754584-7khj7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1ae1a9-b46754584-7khj7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1ae1a9-b46754584-7khj7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-1ae1a9-b46754584-7khj7

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-1ae1a9-7cf7894cb6-jnvff

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1ae1a9-7cf7894cb6-jnvff

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-678134-678bf54484-bs9n6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-678134-744dc4bfd-xkm7f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-678134-openshift-default-b757565f8-v5j82

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-1ae1a9-7cf7894cb6-jnvff

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1ae1a9-b46754584-7khj7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-3f62e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-3f62e6

openshift-ingress

deployment-controller

e2e-shared-a-3f62e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-3f62e6-openshift-default-5bff4bd96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-3f62e6-openshift-default-5bff4bd96

SuccessfulCreate

Created pod: e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

openshift-ingress

multus

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-3f62e6: serviceaccount "payload-processing-e2e-shared-a-3f62e6" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-3f62e6: serviceaccount "payload-processing-e2e-shared-a-3f62e6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696-z5smz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-3f62e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4-v7dm5

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-3f62e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4-v7dm5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4-v7dm5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696-z5smz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4-v7dm5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4-v7dm5

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696-z5smz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696-z5smz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696-z5smz

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-449ecf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-449ecf-openshift-default-5499c4575b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-449ecf-openshift-default-5499c4575b

SuccessfulCreate

Created pod: e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

openshift-ingress

gateway_labeler_controller

e2e-shared-b-449ecf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-449ecf

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-449ecf-d57df55cb-hf5xw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-449ecf-d57df55cb-hf5xw

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-449ecf-d57df55cb-hf5xw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-449ecf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-449ecf-6574556f74 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-449ecf-d57df55cb-hf5xw

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-449ecf-6574556f74

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-449ecf-6574556f74-fvmgh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-449ecf-6574556f74

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-449ecf-6574556f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-449ecf: serviceaccount "payload-processing-e2e-shared-b-449ecf" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-449ecf-d57df55cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-449ecf-d57df55cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-449ecf: serviceaccount "payload-processing-e2e-shared-b-449ecf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-449ecf-d57df55cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-449ecf-d57df55cb-hf5xw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-449ecf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-449ecf-d57df55cb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-449ecf-6574556f74-fvmgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-449ecf-6574556f74-fvmgh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-449ecf-6574556f74-fvmgh

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-449ecf-6574556f74-fvmgh

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-787669-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-787669-openshift-default-57f8c65d56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-787669-openshift-default-57f8c65d56

SuccessfulCreate

Created pod: e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-787669

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-787669

openshift-ingress

multus

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-787669-7d684595bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-787669-7d684595bd-5jhjr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-787669-7d684595bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-787669-7d684595bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-787669: serviceaccount "payload-processing-e2e-ipp-a-787669" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-787669-7d684595bd-5jhjr

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-787669-856dd6bf68

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-787669-856dd6bf68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-787669: serviceaccount "payload-processing-e2e-ipp-a-787669" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-787669-856dd6bf68

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-787669-856dd6bf68-mmwcr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-787669

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-787669-856dd6bf68 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-787669-7d684595bd-5jhjr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-787669-856dd6bf68-mmwcr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-787669-7d684595bd-5jhjr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-787669-7d684595bd-5jhjr

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-787669-856dd6bf68-mmwcr

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-787669-856dd6bf68-mmwcr

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-787669

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-787669-7d684595bd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-787669-856dd6bf68-mmwcr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-5df102

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-5df102

openshift-ingress

deployment-controller

e2e-ipp-b-5df102-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-5df102-openshift-default-8c5f9499b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-5df102-openshift-default-8c5f9499b

SuccessfulCreate

Created pod: e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

openshift-ingress

multus

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5df102-6748fdddcb-xpwxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5df102-6d9586d64

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5df102-6d9586d64-7d8c8

openshift-ingress

multus

payload-processing-e2e-ipp-b-5df102-6748fdddcb-xpwxm

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5df102

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5df102-6d9586d64 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5df102-6748fdddcb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5df102-6748fdddcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5df102: serviceaccount "payload-processing-e2e-ipp-b-5df102" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5df102-6748fdddcb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5df102-6748fdddcb-xpwxm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5df102-6d9586d64

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5df102-6d9586d64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5df102: serviceaccount "payload-processing-e2e-ipp-b-5df102" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5df102

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5df102-6748fdddcb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5df102-6d9586d64-7d8c8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5df102-6d9586d64-7d8c8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5df102-6748fdddcb-xpwxm

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5df102-6d9586d64-7d8c8

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5df102-6d9586d64-7d8c8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5df102-6748fdddcb-xpwxm

Started

Started container payload-processing
(x4)

openshift-ingress

kubelet

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-fd3ebf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-fd3ebf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-fd3ebf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fd3ebf: serviceaccount "payload-processing-e2e-ipp-cleanup-fd3ebf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4-x9hb8

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-fd3ebf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6-5f4nk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-fd3ebf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-fd3ebf: serviceaccount "payload-processing-e2e-ipp-cleanup-fd3ebf" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6-5f4nk

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6-5f4nk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4-x9hb8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4-x9hb8

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4-x9hb8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4-x9hb8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6-5f4nk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6-5f4nk

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-fd3ebf-7fb86759f6-5f4nk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-fd3ebf-86b4dbbb4-x9hb8

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-fd3ebf

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3ebf: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-fd3ebf": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3ebf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 90884590-9273-49ff-ae34-2d5c91fee055, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-787669-856dd6bf68-mmwcr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-787669-7d684595bd-5jhjr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5df102-6d9586d64-7d8c8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5df102-6748fdddcb-xpwxm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-3f62e6-6c87dc4cf4-v7dm5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-3f62e6-7bc6878696-z5smz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-3f62e6-openshift-default-5bff4bd96-lpn96

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-449ecf-6574556f74-fvmgh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-449ecf-d57df55cb-hf5xw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t

Killing

Stopping container istio-proxy