Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874-788b5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874-788b5 to ip-10-0-137-19.ec2.internal

openshift-ingress

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5 to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d-8t92m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d-8t92m to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d-l8tm4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d-l8tm4 to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4-qj5jc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4-qj5jc to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7 to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-dc5a37-77f66db775-tzrbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-dc5a37-77f66db775-tzrbp to ip-10-0-137-19.ec2.internal

openshift-ingress

e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9 to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748 to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-889898-c5b66d6-m2cwm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-889898-c5b66d6-m2cwm to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-processing-e2e-autores-889898-6979449c49-qnzb4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-889898-6979449c49-qnzb4 to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-65fac0-77d6ddbcf5-t2cns

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-65fac0-77d6ddbcf5-t2cns to ip-10-0-137-19.ec2.internal

openshift-ingress

kube-auth-proxy-647997b56d-cbb57

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-647997b56d-cbb57 to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-dc5a37-777d975558-9wf6r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-dc5a37-777d975558-9wf6r to ip-10-0-137-19.ec2.internal

openshift-ingress

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7 to ip-10-0-137-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-65fac0-84774f9d6b-7j2xs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-65fac0-84774f9d6b-7j2xs to ip-10-0-137-19.ec2.internal

openshift-ingress

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-ait-99ff0092-7589b9845-wb64x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-99ff0092-7589b9845-wb64x to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d-j6xnf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d-j6xnf to ip-10-0-137-19.ec2.internal

openshift-ingress

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-53de5224-5d56d9c894-v4zjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-53de5224-5d56d9c894-v4zjf to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d-d558f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d-d558f to ip-10-0-137-19.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-s879k

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-4kjb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-4kjb5 to ip-10-0-137-19.ec2.internal

openshift-ingress

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b-v9fgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b-v9fgg to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l to ip-10-0-140-192.ec2.internal

openshift-ingress

router-default-68d5b75dfd-l6m8l

Scheduled

Successfully assigned openshift-ingress/router-default-68d5b75dfd-l6m8l to ip-10-0-137-217.ec2.internal

openshift-ingress

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c-4h7s7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c-4h7s7 to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-be583c-6d4848d999-qxrws

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-be583c-6d4848d999-qxrws to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967-cx5ww

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967-cx5ww to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47 to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9-9f4ls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9-9f4ls to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-777ae3-5d478f8859-dfsxw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-777ae3-5d478f8859-dfsxw to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-437dd7-7ffc845b7-44dxs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-437dd7-7ffc845b7-44dxs to ip-10-0-137-19.ec2.internal

openshift-ingress

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9 to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-wjvg7

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-wjvg7 to ip-10-0-137-19.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-jbmd9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9 to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649 to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r to ip-10-0-137-217.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-4b53b5-668cff5894-nqxfn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-4b53b5-668cff5894-nqxfn to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-99ff0092-79445585bb-qbcj6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-99ff0092-79445585bb-qbcj6 to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-75bd9a-7d846bc4c5-ps7sb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-75bd9a-7d846bc4c5-ps7sb to ip-10-0-137-19.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j to ip-10-0-140-192.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-b8jmz

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-b8jmz to ip-10-0-137-217.ec2.internal

openshift-ingress

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd to ip-10-0-140-192.ec2.internal

openshift-ingress

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

Scheduled

Successfully assigned openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn to ip-10-0-140-192.ec2.internal

openshift-ingress

kube-auth-proxy-647997b56d-8xz8b

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-647997b56d-8xz8b to ip-10-0-137-19.ec2.internal

openshift-ingress

e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc

Scheduled

Successfully assigned openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc to ip-10-0-140-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m to ip-10-0-140-192.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-2gmhd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2gmhd to ip-10-0-137-217.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-68d5b75dfd from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-68d5b75dfd

FailedCreate

Error creating: pods "router-default-68d5b75dfd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-68d5b75dfd

FailedCreate

Error creating: pods "router-default-68d5b75dfd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-68d5b75dfd

SuccessfulCreate

Created pod: router-default-68d5b75dfd-l6m8l
(x6)

openshift-ingress

kubelet

router-default-68d5b75dfd-l6m8l

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-68d5b75dfd-l6m8l

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-68d5b75dfd-l6m8l

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-68d5b75dfd-l6m8l

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-68d5b75dfd-l6m8l

Created

Created container: router

openshift-ingress

kubelet

router-default-68d5b75dfd-l6m8l

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-647997b56d from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-cbb57

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-647997b56d

SuccessfulCreate

Created pod: kube-auth-proxy-647997b56d-cbb57

openshift-ingress

replicaset-controller

kube-auth-proxy-647997b56d

SuccessfulCreate

Created pod: kube-auth-proxy-647997b56d-8xz8b

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-8xz8b

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-647997b56d

FailedCreate

Error creating: pods "kube-auth-proxy-647997b56d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-647997b56d-8xz8b

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-647997b56d-cbb57

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-8xz8b

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-cbb57

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-s879k

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-s879k

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-s879k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-cbb57

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-cbb57

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-cbb57

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.983s (2.983s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-8xz8b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.262s (3.262s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-8xz8b

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-647997b56d-8xz8b

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-s879k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.448s (3.448s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-s879k

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-s879k

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-s879k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-s879k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-b8jmz

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-b8jmz

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-b8jmz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-b8jmz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.588s (2.588s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-b8jmz

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-b8jmz

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-jbmd9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-jbmd9

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jbmd9

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jbmd9

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jbmd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-s879k

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-s879k
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-2gmhd

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-2gmhd

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-4kjb5

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-4kjb5

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-wjvg7

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wjvg7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-wjvg7

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4kjb5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wjvg7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4kjb5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4kjb5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4kjb5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.628s (2.628s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wjvg7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wjvg7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.475s (2.475s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gmhd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gmhd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gmhd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gmhd

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gmhd

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-dc5a37

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-dc5a37

openshift-ingress

deployment-controller

e2e-inf-a-dc5a37-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-dc5a37-openshift-default-785c489f68 from 0 to 1

openshift-ingress

multus

e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-dc5a37-openshift-default-785c489f68

SuccessfulCreate

Created pod: e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dc5a37-77f66db775

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-dc5a37-77f66db775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dc5a37: serviceaccount "payload-processing-e2e-inf-a-dc5a37" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-dc5a37

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-dc5a37-777d975558 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dc5a37-777d975558

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-dc5a37-777d975558-9wf6r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dc5a37-777d975558

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-dc5a37-777d975558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dc5a37: serviceaccount "payload-processing-e2e-inf-a-dc5a37" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-dc5a37

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-dc5a37-77f66db775 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dc5a37-77f66db775

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-dc5a37-77f66db775-tzrbp

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dc5a37-777d975558-9wf6r

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-dc5a37-777d975558-9wf6r

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dc5a37-777d975558-9wf6r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dc5a37-777d975558-9wf6r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dc5a37-77f66db775-tzrbp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dc5a37-77f66db775-tzrbp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dc5a37-77f66db775-tzrbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-dc5a37-77f66db775-tzrbp

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-889898-openshift-default-5756f89cb6

SuccessfulCreate

Created pod: e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

openshift-ingress

deployment-controller

e2e-autores-889898-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-889898-openshift-default-5756f89cb6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-889898

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-889898

openshift-ingress

gateway_labeler_controller

e2e-ait-99ff0092

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-99ff0092

openshift-ingress

deployment-controller

e2e-ait-99ff0092-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-99ff0092-openshift-default-5d6ff94b78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-99ff0092-openshift-default-5d6ff94b78

SuccessfulCreate

Created pod: e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

openshift-ingress

kubelet

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.689s (2.689s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.481s (2.481s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-99ff0092-79445585bb-qbcj6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-99ff0092-79445585bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-99ff0092-79445585bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-99ff0092: serviceaccount "payload-processing-e2e-ait-99ff0092" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-99ff0092

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-99ff0092-7589b9845 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-99ff0092-79445585bb-qbcj6

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-99ff0092-7589b9845

SuccessfulCreate

Created pod: payload-processing-e2e-ait-99ff0092-7589b9845-wb64x
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-99ff0092-7589b9845

FailedCreate

Error creating: pods "payload-processing-e2e-ait-99ff0092-7589b9845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-99ff0092: serviceaccount "payload-processing-e2e-ait-99ff0092" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-99ff0092

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-99ff0092-79445585bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-99ff0092-79445585bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-99ff0092-79445585bb-qbcj6

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-99ff0092-79445585bb-qbcj6

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-889898-6979449c49

FailedCreate

Error creating: pods "payload-processing-e2e-autores-889898-6979449c49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-889898: serviceaccount "payload-processing-e2e-autores-889898" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-99ff0092-7589b9845-wb64x

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-99ff0092-7589b9845-wb64x

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-99ff0092-79445585bb-qbcj6

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-889898

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-889898-c5b66d6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-889898-c5b66d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-889898-c5b66d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-889898: serviceaccount "payload-processing-e2e-autores-889898" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-99ff0092-7589b9845-wb64x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-889898-6979449c49

SuccessfulCreate

Created pod: payload-processing-e2e-autores-889898-6979449c49-qnzb4

openshift-ingress

kubelet

payload-processing-e2e-ait-99ff0092-7589b9845-wb64x

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-889898

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-889898-6979449c49 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-889898-c5b66d6-m2cwm

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-889898-6979449c49-qnzb4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-889898-c5b66d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-889898-c5b66d6-m2cwm

openshift-ingress

kubelet

payload-processing-e2e-autores-889898-6979449c49-qnzb4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-889898-6979449c49-qnzb4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-889898-c5b66d6-m2cwm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-889898-c5b66d6-m2cwm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-889898-c5b66d6-m2cwm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-889898-6979449c49-qnzb4

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-75bd9a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-75bd9a-openshift-default-7cf57df5d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-75bd9a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-75bd9a

openshift-ingress

replicaset-controller

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4

SuccessfulCreate

Created pod: e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

openshift-ingress

multus

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-75bd9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-75bd9a: serviceaccount "payload-processing-e2e-inf-b-75bd9a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-75bd9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-75bd9a-7d846bc4c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-75bd9a-7d846bc4c5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-75bd9a-7d846bc4c5-ps7sb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-75bd9a-7d846bc4c5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-75bd9a-7d846bc4c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-75bd9a: serviceaccount "payload-processing-e2e-inf-b-75bd9a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874-788b5

openshift-ingress

multus

payload-processing-e2e-inf-b-75bd9a-7d846bc4c5-ps7sb

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874-788b5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874-788b5

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874-788b5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874-788b5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-75bd9a-7d846bc4c5-ps7sb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-75bd9a-7d846bc4c5-ps7sb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-75bd9a-7d846bc4c5-ps7sb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

ProbeError

Readiness probe error: Get "http://10.133.0.31:15021/healthz/ready": read tcp 10.133.0.2:34118->10.133.0.31:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

Unhealthy

Readiness probe failed: Get "http://10.133.0.31:15021/healthz/ready": read tcp 10.133.0.2:34118->10.133.0.31:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-99ff0092-7589b9845-wb64x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-99ff0092-79445585bb-qbcj6

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-53de5224-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-53de5224-gw

openshift-ingress

deployment-controller

e2e-migrate-53de5224-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-53de5224-gw-openshift-default-6b574fbf48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48

SuccessfulCreate

Created pod: e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

openshift-ingress

multus

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-53de5224-5d56d9c894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-53de5224-5d56d9c894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-53de5224: serviceaccount "payload-processing-e2e-migrate-53de5224" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-53de5224-ddc49db46

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-53de5224-ddc49db46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-53de5224: serviceaccount "payload-processing-e2e-migrate-53de5224" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-53de5224

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-53de5224-ddc49db46 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-53de5224

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-53de5224-5d56d9c894 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-53de5224-5d56d9c894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-53de5224-5d56d9c894-v4zjf

openshift-ingress

multus

payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53de5224-5d56d9c894-v4zjf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53de5224-5d56d9c894-v4zjf

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-53de5224-ddc49db46

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt

openshift-ingress

kubelet

payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53de5224-5d56d9c894-v4zjf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-53de5224-5d56d9c894-v4zjf

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.632s (1.632s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": read tcp 10.133.0.2:53562->10.133.0.33:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": read tcp 10.133.0.2:53562->10.133.0.33:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53de5224-5d56d9c894-v4zjf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-4240652e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4240652e

openshift-ingress

replicaset-controller

e2e-ait-4240652e-openshift-default-599fb7b648

SuccessfulCreate

Created pod: e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

openshift-ingress

multus

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-4240652e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4240652e-openshift-default-599fb7b648 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4240652e-69fd8ccc47

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4240652e-58c8469586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4240652e-58c8469586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4240652e: serviceaccount "payload-processing-e2e-ait-4240652e" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4240652e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4240652e-69fd8ccc47 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4240652e-69fd8ccc47

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4240652e-69fd8ccc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4240652e: serviceaccount "payload-processing-e2e-ait-4240652e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4240652e-58c8469586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4240652e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4240652e-58c8469586 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": read tcp 10.133.0.2:52196->10.133.0.37:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": read tcp 10.133.0.2:52196->10.133.0.37:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-f4c26bd5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f4c26bd5-openshift-default-dc88c9976 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-f4c26bd5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f4c26bd5

openshift-ingress

replicaset-controller

e2e-derive-f4c26bd5-openshift-default-dc88c9976

SuccessfulCreate

Created pod: e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748

openshift-ingress

multus

e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-4240652e-openshift-default-599fb7b648-t6bct

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f4c26bd5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f4c26bd5-5b89645db5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f4c26bd5-5b89645db5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f4c26bd5-5b89645db5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f4c26bd5-5b89645db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f4c26bd5: serviceaccount "payload-processing-e2e-derive-f4c26bd5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f4c26bd5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f4c26bd5-65545dc546 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f4c26bd5-65545dc546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f4c26bd5: serviceaccount "payload-processing-e2e-derive-f4c26bd5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f4c26bd5-65545dc546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j

openshift-ingress

multus

payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-889898-6979449c49-qnzb4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-889898-c5b66d6-m2cwm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-f4c26bd5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-f4c26bd5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fad136fd-189a-4999-bd16-50cf39325918, UID in object meta:

openshift-ingress

kubelet

e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-889898-openshift-default-5756f89cb6-t4bmn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-4b53b5-openshift-default-7474cd8ff6

SuccessfulCreate

Created pod: e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc

openshift-ingress

deployment-controller

e2e-explicit-4b53b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-4b53b5-openshift-default-7474cd8ff6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-4b53b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-4b53b5

openshift-ingress

multus

e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-4b53b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-4b53b5-b695cf79c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4b53b5-b695cf79c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4b53b5-668cff5894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-4b53b5-668cff5894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4b53b5: serviceaccount "payload-processing-e2e-explicit-4b53b5" not found

openshift-ingress

multus

payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-4b53b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-4b53b5-668cff5894 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4b53b5-b695cf79c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-4b53b5-b695cf79c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4b53b5: serviceaccount "payload-processing-e2e-explicit-4b53b5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4b53b5-668cff5894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-4b53b5-668cff5894-nqxfn

openshift-ingress

kubelet

payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4b53b5-668cff5894-nqxfn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4b53b5-668cff5894-nqxfn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4b53b5-668cff5894-nqxfn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-4b53b5-668cff5894-nqxfn

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4b53b5-668cff5894-nqxfn

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-6dc6af55

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6dc6af55

openshift-ingress

deployment-controller

e2e-mt-6dc6af55-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6dc6af55-openshift-default-6466bf4c84 from 0 to 1

openshift-ingress

multus

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-6dc6af55-openshift-default-6466bf4c84

SuccessfulCreate

Created pod: e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

openshift-ingress

kubelet

e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-eb108f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-eb108f-openshift-default-d56698d7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-eb108f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-eb108f

openshift-ingress

replicaset-controller

e2e-noten-eb108f-openshift-default-d56698d7b

SuccessfulCreate

Created pod: e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc

openshift-ingress

multus

e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6dc6af55

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6dc6af55-6695dcc5b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d-j6xnf

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dc5a37-77f66db775-tzrbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6dc6af55-6695dcc5b9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6dc6af55-6695dcc5b9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6dc6af55-6695dcc5b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6dc6af55: serviceaccount "payload-processing-e2e-mt-6dc6af55" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6dc6af55: serviceaccount "payload-processing-e2e-mt-6dc6af55" not found

openshift-ingress

kubelet

e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6dc6af55

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dc5a37-777d975558-9wf6r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d-j6xnf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d-j6xnf

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d-j6xnf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d-j6xnf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-dc5a37-openshift-default-785c489f68-cdw2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-75bd9a-6dc4c5874-788b5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-75bd9a-7d846bc4c5-ps7sb

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-75bd9a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-75bd9a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-75bd9a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-75bd9a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fb3a6ded-b6ae-4e82-8042-d77031625c5e, UID in object meta:

openshift-ingress

kubelet

e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-be583c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-be583c-openshift-default-876c8858d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-be583c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-be583c

openshift-ingress

replicaset-controller

e2e-shared-a-w3-be583c-openshift-default-876c8858d

SuccessfulCreate

Created pod: e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

openshift-ingress

multus

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-be583c: serviceaccount "payload-processing-e2e-shared-a-w3-be583c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d-l8tm4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-be583c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-be583c-6d4848d999

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-be583c-6d4848d999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-be583c: serviceaccount "payload-processing-e2e-shared-a-w3-be583c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-be583c-6d4848d999

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-be583c-6d4848d999-qxrws

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-be583c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-be583c-6d4848d999 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d-l8tm4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-be583c-6d4848d999-qxrws

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-be583c-6d4848d999-qxrws

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-be583c-6d4848d999-qxrws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-be583c-6d4848d999-qxrws

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d-l8tm4

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d-l8tm4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d-l8tm4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6dc6af55-6768f4fc5d-j6xnf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-6806f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-6806f1

openshift-ingress

multus

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-6806f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-6806f1-openshift-default-86958bb696 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-6806f1-openshift-default-86958bb696

SuccessfulCreate

Created pod: e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6806f1-575c754979

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-6806f1-575c754979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1: serviceaccount "payload-processing-e2e-shared-b-w3-6806f1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6806f1-575c754979

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-6806f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-6806f1-575c754979 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-6806f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1: serviceaccount "payload-processing-e2e-shared-b-w3-6806f1" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-33b7bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-33b7bb

openshift-ingress

multus

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-33b7bb-openshift-default-5785554488

SuccessfulCreate

Created pod: e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

openshift-ingress

deployment-controller

e2e-shared-a-w2-33b7bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-33b7bb-openshift-default-5785554488 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-33b7bb: serviceaccount "payload-processing-e2e-shared-a-w2-33b7bb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-33b7bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967-cx5ww
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-33b7bb: serviceaccount "payload-processing-e2e-shared-a-w2-33b7bb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-33b7bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4-qj5jc

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967-cx5ww

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967-cx5ww

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4-qj5jc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4-qj5jc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967-cx5ww

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4-qj5jc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4-qj5jc

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967-cx5ww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": read tcp 10.133.0.2:47190->10.133.0.59:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": read tcp 10.133.0.2:47190->10.133.0.59:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-edbcb5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-edbcb5

openshift-ingress

deployment-controller

e2e-shared-b-w2-edbcb5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98

SuccessfulCreate

Created pod: e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-edbcb5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-edbcb5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-edbcb5: serviceaccount "payload-processing-e2e-shared-b-w2-edbcb5" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-edbcb5: serviceaccount "payload-processing-e2e-shared-b-w2-edbcb5" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d-8t92m

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d-8t92m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d-8t92m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d-8t92m

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c-4h7s7

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c-4h7s7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c-4h7s7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c-4h7s7

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d-8t92m

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c-4h7s7
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb

SuccessfulCreate

Created pod: e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

openshift-ingress

deployment-controller

e2e-mt-9d28f397-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9d28f397-openshift-default-7b8b7c9bfb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-9d28f397

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-9d28f397

openshift-ingress

multus

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9d28f397

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9d28f397-7f458c6f66 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9d28f397-6cd4b74585

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9d28f397-7f458c6f66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9d28f397: serviceaccount "payload-processing-e2e-mt-9d28f397" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9d28f397-7f458c6f66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9d28f397

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9d28f397-6cd4b74585 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9d28f397-6cd4b74585

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9d28f397-6cd4b74585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9d28f397: serviceaccount "payload-processing-e2e-mt-9d28f397" not found

openshift-ingress

multus

payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-2549d0-openshift-default-5944fc8648

SuccessfulCreate

Created pod: e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

openshift-ingress

deployment-controller

e2e-api-a-2549d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2549d0-openshift-default-5944fc8648 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-2549d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2549d0

openshift-ingress

multus

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2549d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2549d0-59fdd4d954 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2549d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2549d0-669ff45bff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2549d0-669ff45bff

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks

openshift-ingress

kubelet

payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2549d0-669ff45bff

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2549d0-669ff45bff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2549d0: serviceaccount "payload-processing-e2e-api-a-2549d0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2549d0-59fdd4d954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2549d0-59fdd4d954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2549d0: serviceaccount "payload-processing-e2e-api-a-2549d0" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-65fac0-openshift-default-767b9867cb

SuccessfulCreate

Created pod: e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

openshift-ingress

gateway_labeler_controller

e2e-api-b-65fac0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-65fac0

openshift-ingress

deployment-controller

e2e-api-b-65fac0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-65fac0-openshift-default-767b9867cb from 0 to 1

openshift-ingress

multus

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-65fac0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-65fac0-77d6ddbcf5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-65fac0-77d6ddbcf5-t2cns

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-65fac0-84774f9d6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-65fac0-84774f9d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-65fac0: serviceaccount "payload-processing-e2e-api-b-65fac0" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-65fac0-84774f9d6b-7j2xs

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-65fac0-84774f9d6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-65fac0-84774f9d6b-7j2xs

openshift-ingress

multus

payload-processing-e2e-api-b-65fac0-77d6ddbcf5-t2cns

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-65fac0-77d6ddbcf5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-65fac0-77d6ddbcf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-65fac0: serviceaccount "payload-processing-e2e-api-b-65fac0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-65fac0-84774f9d6b-7j2xs

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-65fac0-77d6ddbcf5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-65fac0-77d6ddbcf5-t2cns

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-65fac0-84774f9d6b-7j2xs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-65fac0-84774f9d6b-7j2xs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-65fac0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-65fac0-84774f9d6b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-65fac0-77d6ddbcf5-t2cns

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-65fac0-77d6ddbcf5-t2cns

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-65fac0-77d6ddbcf5-t2cns

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-65fac0-84774f9d6b-7j2xs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-437dd7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-437dd7

openshift-ingress

multus

e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-437dd7-openshift-default-bd8f94b48

SuccessfulCreate

Created pod: e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x

openshift-ingress

deployment-controller

e2e-ipp-a-437dd7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-437dd7-openshift-default-bd8f94b48 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-33b7bb-749bf8fcf4-qj5jc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-33b7bb-9f5ff9967-cx5ww

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-437dd7-7ffc845b7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-437dd7-7ffc845b7-44dxs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-437dd7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-437dd7: serviceaccount "payload-processing-e2e-ipp-a-437dd7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-437dd7-7ffc845b7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-437dd7-7ffc845b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-437dd7: serviceaccount "payload-processing-e2e-ipp-a-437dd7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-437dd7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-437dd7-7ffc845b7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-437dd7-7ffc845b7-44dxs

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-437dd7-7ffc845b7-44dxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-437dd7-7ffc845b7-44dxs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-437dd7-7ffc845b7-44dxs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-edbcb5-5796c7f67d-8t92m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-edbcb5-5d6f76645c-4h7s7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-ipp-b-777ae3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-777ae3-openshift-default-c45bdf888 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-777ae3-openshift-default-c45bdf888

SuccessfulCreate

Created pod: e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

openshift-ingress

kubelet

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-777ae3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-777ae3
(x5)

openshift-ingress

kubelet

e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b-v9fgg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-777ae3: serviceaccount "payload-processing-e2e-ipp-b-777ae3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-777ae3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-777ae3-5d478f8859 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-777ae3-5d478f8859

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-777ae3-5d478f8859-dfsxw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-777ae3-5d478f8859

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-777ae3-5d478f8859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-777ae3: serviceaccount "payload-processing-e2e-ipp-b-777ae3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-777ae3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b-v9fgg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b-v9fgg

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-777ae3-5d478f8859-dfsxw

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-processing-e2e-ipp-b-777ae3-5d478f8859-dfsxw

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-777ae3-5d478f8859-dfsxw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-777ae3-5d478f8859-dfsxw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b-v9fgg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b-v9fgg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

ProbeError

Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

Unhealthy

Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

openshift-ingress

deployment-controller

e2e-ipp-cleanup-5eebb3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-5eebb3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-5eebb3

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-5eebb3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5eebb3: serviceaccount "payload-processing-e2e-ipp-cleanup-5eebb3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-5eebb3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5eebb3: serviceaccount "payload-processing-e2e-ipp-cleanup-5eebb3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d-d558f

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9-9f4ls

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9-9f4ls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9-9f4ls

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d-d558f

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d-d558f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9-9f4ls

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d-d558f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d-d558f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9-9f4ls

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5eebb3-6bb68b68c9-9f4ls

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-5eebb3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5eebb3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-5eebb3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5eebb3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7d14a7ec-d4a6-458b-a766-fc81fdbeab37, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5eebb3-7c46ff7f5d-d558f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-437dd7-7ffc845b7-44dxs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-777ae3-85b74dd54b-v9fgg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-777ae3-5d478f8859-dfsxw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-be583c-58b98f9b9d-l8tm4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-be583c-6d4848d999-qxrws

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-be583c-openshift-default-876c8858d-76gc7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f

Unhealthy

Readiness probe failed: dial tcp 10.133.0.58:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm

Killing

Stopping container istio-proxy