Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-inf-a-1d8cb1-568bf6b67f-5ht8s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1d8cb1-568bf6b67f-5ht8s to ip-10-0-142-80.ec2.internal

openshift-ingress

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l to ip-10-0-142-80.ec2.internal

openshift-ingress

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-derive-18913a0c-6d84f859df-9bj4k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-18913a0c-6d84f859df-9bj4k to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-processing-e2e-autores-0eaf99-6b47649f65-v6jj6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-0eaf99-6b47649f65-v6jj6 to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-179a6f-575f9bc89c-ggs9b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-179a6f-575f9bc89c-ggs9b to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ff349c-5cf6d89bcc-7rxzr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ff349c-5cf6d89bcc-7rxzr to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr to ip-10-0-142-80.ec2.internal

openshift-ingress

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

Scheduled

Successfully assigned openshift-ingress/e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-ait-abd9a747-54b9ffd4d5-m9gsq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-abd9a747-54b9ffd4d5-m9gsq to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-15d796-668bc7c5d-6m7d9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-15d796-668bc7c5d-6m7d9 to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-processing-e2e-ait-12c5e22e-668587448f-8wbdc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-12c5e22e-668587448f-8wbdc to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-c5ee49-769f8766f-974kf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c5ee49-769f8766f-974kf to ip-10-0-142-80.ec2.internal

openshift-ingress

e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh to ip-10-0-142-80.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-phc6x

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phc6x to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6-6fxct

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6-6fxct to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-c5hn5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-c5hn5 to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-18913a0c-df86496c8-vktz6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-18913a0c-df86496c8-vktz6 to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-2lwjs

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-2lwjs to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b-j58cg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b-j58cg to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6-l8bq9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6-l8bq9 to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

Scheduled

Successfully assigned openshift-ingress/e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-792c35-7857564994-tk7nb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-792c35-7857564994-tk7nb to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-jx6hr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-jx6hr to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4-q5rjx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4-q5rjx to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8-mb6mq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8-mb6mq to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966-wpkmg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966-wpkmg to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-179a6f-68c5f896cd-wg7q2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-179a6f-68c5f896cd-wg7q2 to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6-xnp8t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6-xnp8t to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b-msc8m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b-msc8m to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5 to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-783195cb-574777cd78-f25lk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-783195cb-574777cd78-f25lk to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2e25b35c-67d478989d-c96tj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2e25b35c-67d478989d-c96tj to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn to ip-10-0-142-80.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-tmgsr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmgsr to ip-10-0-142-80.ec2.internal

openshift-ingress

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm to ip-10-0-142-80.ec2.internal

openshift-ingress

e2e-noten-058a11-openshift-default-c598c5b88-46x5q

Scheduled

Successfully assigned openshift-ingress/e2e-noten-058a11-openshift-default-c598c5b88-46x5q to ip-10-0-142-80.ec2.internal

openshift-ingress

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw to ip-10-0-139-112.ec2.internal

openshift-ingress

kube-auth-proxy-6d985cc74d-b2kg9

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6d985cc74d-b2kg9 to ip-10-0-139-112.ec2.internal

openshift-ingress

kube-auth-proxy-6d985cc74d-9hb2s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6d985cc74d-9hb2s to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86-sqb2q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86-sqb2q to ip-10-0-142-80.ec2.internal

openshift-ingress

e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg

Scheduled

Successfully assigned openshift-ingress/e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg to ip-10-0-142-80.ec2.internal

openshift-ingress

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8 to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2e25b35c-778dc4c9b5-j75zz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2e25b35c-778dc4c9b5-j75zz to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-ad9a714c-5ff44569c8-nx5lf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-ad9a714c-5ff44569c8-nx5lf to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5 to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6-fpzx2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6-fpzx2 to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9-68wf8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9-68wf8 to ip-10-0-139-112.ec2.internal

openshift-ingress

router-default-7bdcf569fd-2mtjd

Scheduled

Successfully assigned openshift-ingress/router-default-7bdcf569fd-2mtjd to ip-10-0-139-112.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-kw8r7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-kw8r7 to ip-10-0-141-6.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69-ht44s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69-ht44s to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc-tl7px

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc-tl7px to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-792c35-58c4747d8f-cg757

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-792c35-58c4747d8f-cg757 to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-6vk9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-6vk9h to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-processing-e2e-mt-783195cb-7c4d68689-9v79z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-783195cb-7c4d68689-9v79z to ip-10-0-139-112.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d-5qvzf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d-5qvzf to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-hrsx4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-hrsx4 to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-302afb-5f585bf4c-q9ldr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-302afb-5f585bf4c-q9ldr to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng

Scheduled

Successfully assigned openshift-ingress/e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-15d796-5c8bd9fb99-2zv2v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-15d796-5c8bd9fb99-2zv2v to ip-10-0-139-112.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-h96wf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h96wf to ip-10-0-142-80.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc-bnmh4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc-bnmh4 to ip-10-0-139-112.ec2.internal

openshift-ingress

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp to ip-10-0-142-80.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7bdcf569fd from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-7bdcf569fd

FailedCreate

Error creating: pods "router-default-7bdcf569fd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7bdcf569fd

FailedCreate

Error creating: pods "router-default-7bdcf569fd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7bdcf569fd

SuccessfulCreate

Created pod: router-default-7bdcf569fd-2mtjd
(x6)

openshift-ingress

kubelet

router-default-7bdcf569fd-2mtjd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-7bdcf569fd-2mtjd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-7bdcf569fd-2mtjd

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7bdcf569fd-2mtjd

Started

Started container router

openshift-ingress

kubelet

router-default-7bdcf569fd-2mtjd

Created

Created container: router

openshift-ingress

kubelet

router-default-7bdcf569fd-2mtjd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-6d985cc74d

SuccessfulCreate

Created pod: kube-auth-proxy-6d985cc74d-b2kg9

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6d985cc74d from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-9hb2s

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-b2kg9

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-6d985cc74d

FailedCreate

Error creating: pods "kube-auth-proxy-6d985cc74d-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6d985cc74d

SuccessfulCreate

Created pod: kube-auth-proxy-6d985cc74d-9hb2s

openshift-ingress

multus

kube-auth-proxy-6d985cc74d-9hb2s

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-9hb2s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6d985cc74d-b2kg9

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-b2kg9

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-h96wf

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-h96wf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-h96wf

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-b2kg9

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-b2kg9

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-b2kg9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.264s (3.264s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-9hb2s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.604s (4.604s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-9hb2s

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6d985cc74d-9hb2s

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-h96wf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.149s (5.149s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-h96wf

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-h96wf

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-kw8r7

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-h96wf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-h96wf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-kw8r7

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kw8r7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-phc6x

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-phc6x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-phc6x

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kw8r7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kw8r7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kw8r7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.603s (2.603s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-phc6x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.897s (2.897s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-phc6x

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-phc6x

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-h96wf

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-h96wf

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-tmgsr

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-tmgsr

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-hrsx4

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-2lwjs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2lwjs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hrsx4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-hrsx4

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-2lwjs

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2lwjs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.398s (2.398s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hrsx4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.375s (2.375s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2lwjs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2lwjs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hrsx4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hrsx4

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tmgsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tmgsr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tmgsr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tmgsr

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tmgsr

ProbeError

Startup probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44

SuccessfulCreate

Created pod: e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

openshift-ingress

deployment-controller

e2e-inf-a-1d8cb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1d8cb1-openshift-default-7c489cdd44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1d8cb1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1d8cb1

openshift-ingress

multus

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1d8cb1: serviceaccount "payload-processing-e2e-inf-a-1d8cb1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1d8cb1-568bf6b67f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1d8cb1-568bf6b67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1d8cb1: serviceaccount "payload-processing-e2e-inf-a-1d8cb1" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-1d8cb1-568bf6b67f-5ht8s

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1d8cb1-568bf6b67f-5ht8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1d8cb1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1d8cb1-568bf6b67f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6-6fxct

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6-6fxct

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1d8cb1-568bf6b67f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1d8cb1-568bf6b67f-5ht8s

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6-6fxct

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6-6fxct

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1d8cb1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6-6fxct

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1d8cb1-568bf6b67f-5ht8s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1d8cb1-568bf6b67f-5ht8s

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-ait-abd9a747-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-abd9a747-openshift-default-675d69c7c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-abd9a747

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-abd9a747

openshift-ingress

deployment-controller

e2e-autores-0eaf99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-0eaf99-openshift-default-6885f8956b from 0 to 1

openshift-ingress

multus

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-0eaf99-openshift-default-6885f8956b

SuccessfulCreate

Created pod: e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng

openshift-ingress

gateway_labeler_controller

e2e-autores-0eaf99

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-0eaf99

openshift-ingress

replicaset-controller

e2e-ait-abd9a747-openshift-default-675d69c7c8

SuccessfulCreate

Created pod: e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

openshift-ingress

multus

e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-abd9a747-54b9ffd4d5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-abd9a747-54b9ffd4d5-m9gsq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6-fpzx2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-abd9a747: serviceaccount "payload-processing-e2e-ait-abd9a747" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-abd9a747-54b9ffd4d5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-abd9a747-54b9ffd4d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-abd9a747: serviceaccount "payload-processing-e2e-ait-abd9a747" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-abd9a747

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-abd9a747

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-abd9a747-54b9ffd4d5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6-fpzx2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6-fpzx2

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6-fpzx2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-abd9a747-54b9ffd4d5-m9gsq

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-abd9a747-54b9ffd4d5-m9gsq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6-fpzx2

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0eaf99: serviceaccount "payload-processing-e2e-autores-0eaf99" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4-q5rjx

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4-q5rjx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-0eaf99

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-0eaf99

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-0eaf99-6b47649f65 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0eaf99-6b47649f65

SuccessfulCreate

Created pod: payload-processing-e2e-autores-0eaf99-6b47649f65-v6jj6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0eaf99-6b47649f65

FailedCreate

Error creating: pods "payload-processing-e2e-autores-0eaf99-6b47649f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0eaf99: serviceaccount "payload-processing-e2e-autores-0eaf99" not found

openshift-ingress

multus

payload-processing-e2e-autores-0eaf99-6b47649f65-v6jj6

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4-q5rjx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4-q5rjx

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-0eaf99-6b47649f65-v6jj6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 375ms (375ms including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-autores-0eaf99-6b47649f65-v6jj6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-autores-0eaf99-6b47649f65-v6jj6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4-q5rjx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-abd9a747-54b9ffd4d5-m9gsq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-0eaf99-6b47649f65-v6jj6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-abd9a747-54b9ffd4d5-m9gsq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-abd9a747-54b9ffd4d5-m9gsq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.85s (1.85s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:37972->10.134.0.37:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:37972->10.134.0.37:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

Started

Started container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-15d796

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-15d796-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-15d796-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-b-15d796

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-15d796

openshift-ingress

deployment-controller

e2e-inf-b-15d796-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-15d796-openshift-default-756bcdf87b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-15d796-openshift-default-756bcdf87b

SuccessfulCreate

Created pod: e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw
(x2)

openshift-ingress

kubelet

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.687s (2.687s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

kubelet

e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-15d796-5c8bd9fb99

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-15d796-5c8bd9fb99-2zv2v
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-15d796-5c8bd9fb99

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-15d796-5c8bd9fb99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-15d796: serviceaccount "payload-processing-e2e-inf-b-15d796" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-15d796

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-15d796-5c8bd9fb99 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-15d796-668bc7c5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-15d796-668bc7c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-15d796: serviceaccount "payload-processing-e2e-inf-b-15d796" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-15d796-668bc7c5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-15d796-668bc7c5d-6m7d9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-15d796

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-15d796-668bc7c5d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-15d796-668bc7c5d-6m7d9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-15d796-668bc7c5d-6m7d9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-15d796-668bc7c5d-6m7d9

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-15d796-5c8bd9fb99-2zv2v

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-15d796-5c8bd9fb99-2zv2v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-15d796-668bc7c5d-6m7d9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-15d796-5c8bd9fb99-2zv2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-15d796-5c8bd9fb99-2zv2v

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-abd9a747-54b9ffd4d5-m9gsq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-abd9a747-openshift-default-675d69c7c8-mr8ld

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-abd9a747-68bbbdd4b6-fpzx2

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-ad9a714c-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-ad9a714c-gw

openshift-ingress

multus

e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4

SuccessfulCreate

Created pod: e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5

openshift-ingress

deployment-controller

e2e-migrate-ad9a714c-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-ad9a714c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-ad9a714c-5ff44569c8 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b-msc8m

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ad9a714c-5ff44569c8

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-ad9a714c-5ff44569c8-nx5lf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-ad9a714c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b-msc8m
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ad9a714c-5ff44569c8

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-ad9a714c-5ff44569c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ad9a714c: serviceaccount "payload-processing-e2e-migrate-ad9a714c" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-ad9a714c-5ff44569c8-nx5lf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b-msc8m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b-msc8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b-msc8m

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-ad9a714c-5ff44569c8-nx5lf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-ad9a714c-5ff44569c8-nx5lf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-ad9a714c-5ff44569c8-nx5lf

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ad9a714c: serviceaccount "payload-processing-e2e-migrate-ad9a714c" not found
(x2)

openshift-ingress

kubelet

e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-ad9a714c-gw-openshift-default-68696ccbb4-5r2b5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ad9a714c-566fbbb86b-msc8m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-ad9a714c-5ff44569c8-nx5lf

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-ad9a714c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-ad9a714c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-ad9a714c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-ad9a714c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 70444ee9-c609-43dd-baea-23bb8c8c6ea8, UID in object meta:

openshift-ingress

gateway_labeler_controller

e2e-ait-12c5e22e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-12c5e22e

openshift-ingress

deployment-controller

e2e-ait-12c5e22e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-12c5e22e-openshift-default-84496bfcbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-12c5e22e-openshift-default-84496bfcbb

SuccessfulCreate

Created pod: e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

openshift-ingress

multus

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-12c5e22e-668587448f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-12c5e22e-668587448f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-12c5e22e: serviceaccount "payload-processing-e2e-ait-12c5e22e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-12c5e22e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-12c5e22e-668587448f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-12c5e22e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-12c5e22e: serviceaccount "payload-processing-e2e-ait-12c5e22e" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-12c5e22e-668587448f-8wbdc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86-sqb2q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86-sqb2q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86-sqb2q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-12c5e22e-668587448f-8wbdc

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86-sqb2q

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-12c5e22e-668587448f-8wbdc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-12c5e22e-668587448f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-12c5e22e-668587448f-8wbdc

openshift-ingress

multus

payload-processing-e2e-ait-12c5e22e-668587448f-8wbdc

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86-sqb2q

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:34084->10.132.0.56:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:34084->10.132.0.56:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-12c5e22e-668587448f-8wbdc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-12c5e22e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-12c5e22e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-12c5e22e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-12c5e22e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4fabf084-e2a6-4b30-8d3c-0c05b1ad5d7a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-12c5e22e-5cbd7f7c86-sqb2q

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-derive-18913a0c-openshift-default-7b566fffc6

SuccessfulCreate

Created pod: e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-18913a0c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-18913a0c-openshift-default-7b566fffc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-18913a0c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-18913a0c

openshift-ingress

multus

e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-12c5e22e-openshift-default-84496bfcbb-hfcfp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-derive-18913a0c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-18913a0c-6d84f859df from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-18913a0c-df86496c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-18913a0c-df86496c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-18913a0c: serviceaccount "payload-processing-e2e-derive-18913a0c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-18913a0c-df86496c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-18913a0c-df86496c8-vktz6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-18913a0c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-18913a0c-df86496c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-18913a0c-6d84f859df

FailedCreate

Error creating: pods "payload-processing-e2e-derive-18913a0c-6d84f859df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-18913a0c: serviceaccount "payload-processing-e2e-derive-18913a0c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-18913a0c-6d84f859df

SuccessfulCreate

Created pod: payload-processing-e2e-derive-18913a0c-6d84f859df-9bj4k

openshift-ingress

multus

payload-processing-e2e-derive-18913a0c-6d84f859df-9bj4k

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-18913a0c-df86496c8-vktz6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-18913a0c-6d84f859df-9bj4k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-18913a0c-6d84f859df-9bj4k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-18913a0c-6d84f859df-9bj4k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-18913a0c-df86496c8-vktz6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-18913a0c-df86496c8-vktz6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-18913a0c-df86496c8-vktz6

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-0eaf99-6b47649f65-v6jj6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0eaf99-66bd5ffff4-q5rjx

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-18913a0c-df86496c8-vktz6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-18913a0c-openshift-default-7b566fffc6-8nshg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-18913a0c-6d84f859df-9bj4k

Killing

Stopping container payload-processing

openshift-ingress

GatewayAuthBootstrap

e2e-explicit-c5ee49

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-explicit-c5ee49-authn-ssl: envoyfilters.networking.istio.io "e2e-explicit-c5ee49-authn-ssl" already exists

openshift-ingress

kubelet

e2e-autores-0eaf99-openshift-default-6885f8956b-g4xng

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-c5ee49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c5ee49

openshift-ingress

replicaset-controller

e2e-explicit-c5ee49-openshift-default-54899598bd

SuccessfulCreate

Created pod: e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn

openshift-ingress

deployment-controller

e2e-explicit-c5ee49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c5ee49-openshift-default-54899598bd from 0 to 1

openshift-ingress

multus

e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-c5ee49-769f8766f-974kf

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c5ee49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c5ee49-c9b759f94 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-c5ee49-769f8766f-974kf

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-c5hn5

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c5ee49-769f8766f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c5ee49-769f8766f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c5ee49: serviceaccount "payload-processing-e2e-explicit-c5ee49" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c5ee49-769f8766f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c5ee49-769f8766f-974kf

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c5ee49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c5ee49-769f8766f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-c5hn5

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c5ee49-c9b759f94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c5ee49: serviceaccount "payload-processing-e2e-explicit-c5ee49" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c5ee49-c9b759f94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-c5hn5

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-c5hn5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-c5ee49-769f8766f-974kf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-c5ee49-769f8766f-974kf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-c5hn5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-c5hn5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c5ee49-c9b759f94-c5hn5

Unhealthy

Readiness probe failed: dial tcp 10.132.0.59:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-c5ee49-769f8766f-974kf

Unhealthy

Readiness probe failed: dial tcp 10.134.0.57:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-c5ee49-769f8766f-974kf

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-noten-058a11-openshift-default-c598c5b88

SuccessfulCreate

Created pod: e2e-noten-058a11-openshift-default-c598c5b88-46x5q

openshift-ingress

kubelet

e2e-explicit-c5ee49-openshift-default-54899598bd-nt4wn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-058a11

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-058a11

openshift-ingress

deployment-controller

e2e-noten-058a11-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-058a11-openshift-default-c598c5b88 from 0 to 1

openshift-ingress

kubelet

e2e-noten-058a11-openshift-default-c598c5b88-46x5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-058a11-openshift-default-c598c5b88-46x5q

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-058a11-openshift-default-c598c5b88-46x5q

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-058a11-openshift-default-c598c5b88-46x5q

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-2e25b35c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2e25b35c-openshift-default-565c6c4bd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-2e25b35c-openshift-default-565c6c4bd4

SuccessfulCreate

Created pod: e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

openshift-ingress

gateway_labeler_controller

e2e-mt-2e25b35c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2e25b35c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2e25b35c-67d478989d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2e25b35c-67d478989d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2e25b35c: serviceaccount "payload-processing-e2e-mt-2e25b35c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2e25b35c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2e25b35c-778dc4c9b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2e25b35c-778dc4c9b5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2e25b35c-778dc4c9b5-j75zz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2e25b35c-778dc4c9b5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2e25b35c-778dc4c9b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2e25b35c: serviceaccount "payload-processing-e2e-mt-2e25b35c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2e25b35c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2e25b35c-67d478989d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2e25b35c-67d478989d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2e25b35c-67d478989d-c96tj

openshift-ingress

multus

payload-pre-processing-e2e-mt-2e25b35c-67d478989d-c96tj

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2e25b35c-67d478989d-c96tj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2e25b35c-778dc4c9b5-j75zz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2e25b35c-67d478989d-c96tj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2e25b35c-778dc4c9b5-j75zz

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-2e25b35c-778dc4c9b5-j75zz

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2e25b35c-778dc4c9b5-j75zz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2e25b35c-67d478989d-c96tj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-058a11-openshift-default-c598c5b88-46x5q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-058a11-openshift-default-c598c5b88-46x5q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-noten-058a11-openshift-default-c598c5b88-46x5q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:41956->10.132.0.61:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:41956->10.132.0.61:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1d8cb1-5d67cbfb6-6fxct

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-1d8cb1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-1d8cb1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-1d8cb1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-1d8cb1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bd63aa34-621f-438f-928b-ad7979fe6b13, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1d8cb1-568bf6b67f-5ht8s

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-1d8cb1-openshift-default-7c489cdd44-8ddrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-15d796-668bc7c5d-6m7d9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-15d796-5c8bd9fb99-2zv2v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2e25b35c-67d478989d-c96tj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2e25b35c-778dc4c9b5-j75zz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-15d796-openshift-default-756bcdf87b-kk4xw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-792c35

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-792c35

openshift-ingress

deployment-controller

e2e-shared-a-w3-792c35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-792c35-openshift-default-54cc686cc4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4

SuccessfulCreate

Created pod: e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

openshift-ingress

multus

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-792c35

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-792c35-7857564994 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-792c35

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-792c35-58c4747d8f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-792c35-7857564994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-792c35-7857564994-tk7nb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-792c35-7857564994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-792c35-7857564994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-792c35: serviceaccount "payload-processing-e2e-shared-a-w3-792c35" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-792c35-58c4747d8f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-792c35-58c4747d8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-792c35: serviceaccount "payload-processing-e2e-shared-a-w3-792c35" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-792c35-58c4747d8f-cg757

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-792c35-7857564994-tk7nb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-792c35-7857564994-tk7nb

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-792c35-58c4747d8f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-792c35-58c4747d8f-cg757

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-792c35-58c4747d8f-cg757

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-792c35-58c4747d8f-cg757

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-2e25b35c-openshift-default-565c6c4bd4-mfsjj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-792c35-58c4747d8f-cg757

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-792c35-7857564994-tk7nb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-792c35-7857564994-tk7nb

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-3b04d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-3b04d6

openshift-ingress

replicaset-controller

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6

SuccessfulCreate

Created pod: e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

openshift-ingress

deployment-controller

e2e-shared-a-w2-3b04d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-6vk9h

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3b04d6: serviceaccount "payload-processing-e2e-shared-a-w2-3b04d6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-3b04d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-6vk9h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-3b04d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-jx6hr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3b04d6: serviceaccount "payload-processing-e2e-shared-a-w2-3b04d6" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-6vk9h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-jx6hr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-jx6hr

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-6vk9h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-6vk9h

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-jx6hr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-jx6hr

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-6255f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-6255f2

openshift-ingress

replicaset-controller

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4

SuccessfulCreate

Created pod: e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

openshift-ingress

deployment-controller

e2e-shared-b-w3-6255f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-6255f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6255f2: serviceaccount "payload-processing-e2e-shared-b-w3-6255f2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b-j58cg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b-j58cg

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-6255f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69-ht44s

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6255f2: serviceaccount "payload-processing-e2e-shared-b-w3-6255f2" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69-ht44s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69-ht44s

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b-j58cg

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69-ht44s

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69-ht44s

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b-j58cg

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b-j58cg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": read tcp 10.134.0.2:42930->10.134.0.69:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": read tcp 10.134.0.2:42930->10.134.0.69:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-951c3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-951c3e

openshift-ingress

deployment-controller

e2e-shared-b-w2-951c3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b

SuccessfulCreate

Created pod: e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh

openshift-ingress

kubelet

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-951c3e: serviceaccount "payload-processing-e2e-shared-b-w2-951c3e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6-l8bq9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-951c3e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-951c3e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-951c3e: serviceaccount "payload-processing-e2e-shared-b-w2-951c3e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc-tl7px

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc-tl7px

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6-l8bq9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc-tl7px

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc-tl7px

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6-l8bq9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6-l8bq9

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6-l8bq9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc-tl7px

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-mt-783195cb

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-783195cb-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-783195cb-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-mt-783195cb-openshift-default-6bf4bbfd7b

SuccessfulCreate

Created pod: e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

openshift-ingress

deployment-controller

e2e-mt-783195cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-783195cb-openshift-default-6bf4bbfd7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-783195cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-783195cb

openshift-ingress

multus

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-783195cb-7c4d68689

SuccessfulCreate

Created pod: payload-processing-e2e-mt-783195cb-7c4d68689-9v79z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-783195cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-783195cb-574777cd78 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-783195cb-574777cd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-783195cb-574777cd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-783195cb: serviceaccount "payload-processing-e2e-mt-783195cb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-783195cb-7c4d68689

FailedCreate

Error creating: pods "payload-processing-e2e-mt-783195cb-7c4d68689-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-783195cb: serviceaccount "payload-processing-e2e-mt-783195cb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-783195cb-574777cd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-783195cb-574777cd78-f25lk

openshift-ingress

deployment-controller

payload-processing-e2e-mt-783195cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-783195cb-7c4d68689 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-783195cb-7c4d68689-9v79z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-783195cb-7c4d68689-9v79z

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-783195cb-7c4d68689-9v79z

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-783195cb-7c4d68689-9v79z

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-783195cb-574777cd78-f25lk

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-783195cb-574777cd78-f25lk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-783195cb-574777cd78-f25lk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-783195cb-574777cd78-f25lk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-783195cb-574777cd78-f25lk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-783195cb-7c4d68689-9v79z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-783195cb-openshift-default-6bf4bbfd7b-w2bjr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-ff349c-openshift-default-7bff5c6cbb

SuccessfulCreate

Created pod: e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

openshift-ingress

deployment-controller

e2e-api-a-ff349c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ff349c-openshift-default-7bff5c6cbb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-ff349c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ff349c

openshift-ingress

multus

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ff349c-5cf6d89bcc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ff349c-5cf6d89bcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ff349c: serviceaccount "payload-processing-e2e-api-a-ff349c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ff349c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ff349c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ff349c-5cf6d89bcc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ff349c-5cf6d89bcc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ff349c-5cf6d89bcc-7rxzr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ff349c: serviceaccount "payload-processing-e2e-api-a-ff349c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d-5qvzf

openshift-ingress

kubelet

payload-processing-e2e-api-a-ff349c-5cf6d89bcc-7rxzr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d-5qvzf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d-5qvzf

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ff349c-5cf6d89bcc-7rxzr

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-ff349c-5cf6d89bcc-7rxzr

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ff349c-5cf6d89bcc-7rxzr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d-5qvzf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d-5qvzf

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-179a6f-openshift-default-746bb7844b

SuccessfulCreate

Created pod: e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

openshift-ingress

gateway_labeler_controller

e2e-api-b-179a6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-179a6f

openshift-ingress

deployment-controller

e2e-api-b-179a6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-179a6f-openshift-default-746bb7844b from 0 to 1

openshift-ingress

multus

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-179a6f-68c5f896cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-179a6f-68c5f896cd-wg7q2

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-179a6f-575f9bc89c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-179a6f-575f9bc89c-ggs9b

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-179a6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-179a6f-575f9bc89c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-179a6f-575f9bc89c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-179a6f-575f9bc89c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-179a6f: serviceaccount "payload-processing-e2e-api-b-179a6f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-179a6f-68c5f896cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-179a6f-68c5f896cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-179a6f: serviceaccount "payload-processing-e2e-api-b-179a6f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-179a6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-179a6f-68c5f896cd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-179a6f-575f9bc89c-ggs9b

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-179a6f-575f9bc89c-ggs9b

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-179a6f-68c5f896cd-wg7q2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-179a6f-68c5f896cd-wg7q2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-179a6f-575f9bc89c-ggs9b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-179a6f-68c5f896cd-wg7q2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-179a6f-575f9bc89c-ggs9b

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-179a6f-68c5f896cd-wg7q2

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-ff349c-5cf6d89bcc-7rxzr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ff349c-7c95bbd97d-5qvzf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-ff349c-openshift-default-7bff5c6cbb-lbztb

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-179a6f-575f9bc89c-ggs9b

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-179a6f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-179a6f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-179a6f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-179a6f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e92889d2-ef13-4d52-9365-50e2a581a7d7, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-179a6f-68c5f896cd-wg7q2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-179a6f-openshift-default-746bb7844b-gkfw5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-6vk9h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-jx6hr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3b04d6-5f657ddf9f-6vk9h

Unhealthy

Readiness probe failed: dial tcp 10.132.0.63:9004: i/o timeout

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3b04d6-86d98c5cf8-jx6hr

Unhealthy

Readiness probe failed: dial tcp 10.132.0.64:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-a-w2-3b04d6-openshift-default-55647b5c6-wsc9p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-951c3e-6869d8c4dc-tl7px

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-951c3e-6657c964d6-l8bq9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-951c3e-openshift-default-64b955cf9b-bx9bh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d

SuccessfulCreate

Created pod: e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bc23ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bc23ef

openshift-ingress

deployment-controller

e2e-ipp-a-bc23ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8-mb6mq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bc23ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bc23ef: serviceaccount "payload-processing-e2e-ipp-a-bc23ef" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc-bnmh4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bc23ef: serviceaccount "payload-processing-e2e-ipp-a-bc23ef" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bc23ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc-bnmh4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8-mb6mq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc-bnmh4

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8-mb6mq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc-bnmh4

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8-mb6mq

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc-bnmh4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8-mb6mq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-302afb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-302afb

openshift-ingress

replicaset-controller

e2e-ipp-b-302afb-openshift-default-58c44d6bbd

SuccessfulCreate

Created pod: e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

openshift-ingress

deployment-controller

e2e-ipp-b-302afb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-302afb-openshift-default-58c44d6bbd from 0 to 1

openshift-ingress

multus

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-302afb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-302afb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-302afb-5f585bf4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-302afb-5f585bf4c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-302afb-5f585bf4c-q9ldr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-302afb-5f585bf4c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-302afb-5f585bf4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-302afb: serviceaccount "payload-processing-e2e-ipp-b-302afb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-302afb: serviceaccount "payload-processing-e2e-ipp-b-302afb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966-wpkmg

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-302afb-5f585bf4c-q9ldr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-302afb-5f585bf4c-q9ldr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-302afb-5f585bf4c-q9ldr

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-302afb-5f585bf4c-q9ldr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966-wpkmg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966-wpkmg

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966-wpkmg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966-wpkmg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

ProbeError

Readiness probe error: Get "http://10.134.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

Unhealthy

Readiness probe failed: Get "http://10.134.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96

SuccessfulCreate

Created pod: e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-61f4b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-61f4b7

openshift-ingress

deployment-controller

e2e-ipp-cleanup-61f4b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-61f4b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9-68wf8

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9-68wf8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6-xnp8t

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9-68wf8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6-xnp8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-61f4b7: serviceaccount "payload-processing-e2e-ipp-cleanup-61f4b7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-61f4b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6-xnp8t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6-xnp8t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9-68wf8

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-61f4b7: serviceaccount "payload-processing-e2e-ipp-cleanup-61f4b7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9-68wf8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6-xnp8t
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-61f4b7-54c4bfb4d6-xnp8t

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-61f4b7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-61f4b7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-61f4b7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-61f4b7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f4e0a116-d0fb-4180-b78d-f793342351a6, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-61f4b7-c57c975f9-68wf8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-61f4b7-openshift-default-db94c6f96-cdw2l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bc23ef-7b4dd97bdc-bnmh4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bc23ef-6f4c74f9c8-mb6mq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-bc23ef-openshift-default-7fc4c5cc4d-vn9k8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-302afb-5f585bf4c-q9ldr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-302afb-7bf5f4f966-wpkmg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-302afb-openshift-default-58c44d6bbd-2clrp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-792c35-58c4747d8f-cg757

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-792c35-7857564994-tk7nb

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-792c35

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-792c35: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-792c35": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-792c35, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7da4a2db-738c-4f7a-b20d-c68f33a9676c, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-792c35-openshift-default-54cc686cc4-s72pm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6255f2-7bd6bfbb69-ht44s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6255f2-5b689d4b8b-j58cg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-6255f2-openshift-default-5854ff94c4-2s2lt

Killing

Stopping container istio-proxy