Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6-fnq6c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6-fnq6c to ip-10-0-129-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl to ip-10-0-133-7.ec2.internal

openshift-ingress

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7 to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5 to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld to ip-10-0-131-31.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-hz7x2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-hz7x2 to ip-10-0-133-7.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-w7h2m

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-w7h2m to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw to ip-10-0-131-31.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-v55gs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-v55gs to ip-10-0-129-223.ec2.internal

openshift-ingress

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9 to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz to ip-10-0-131-31.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9 to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0f99172f-685d677d8d-rg5mr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0f99172f-685d677d8d-rg5mr to ip-10-0-129-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7 to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl to ip-10-0-133-7.ec2.internal

openshift-ingress

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

Scheduled

Successfully assigned openshift-ingress/e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4 to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w to ip-10-0-133-7.ec2.internal

openshift-ingress

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz to ip-10-0-131-31.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-mt-bc10550f-858c5684cd-c94db

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-bc10550f-858c5684cd-c94db to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4-wssxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4-wssxm to ip-10-0-129-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg to ip-10-0-133-7.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cn74bt

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cn74bt to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4 to ip-10-0-131-31.ec2.internal

openshift-ingress

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d to ip-10-0-131-31.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d-wf6ws

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d-wf6ws to ip-10-0-129-223.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-gm89x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-gm89x to ip-10-0-129-223.ec2.internal

openshift-ingress

router-default-cf88d7cdf-w5kz2

Scheduled

Successfully assigned openshift-ingress/router-default-cf88d7cdf-w5kz2 to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf to ip-10-0-133-7.ec2.internal

openshift-ingress

kube-auth-proxy-5c857974d4-g2dnm

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5c857974d4-g2dnm to ip-10-0-129-223.ec2.internal

openshift-ingress

payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8-2mtt4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8-2mtt4 to ip-10-0-129-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p to ip-10-0-133-7.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-csc8g

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-csc8g to ip-10-0-129-223.ec2.internal

openshift-ingress

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd to ip-10-0-131-31.ec2.internal

openshift-ingress

kube-auth-proxy-5c857974d4-r6zml

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5c857974d4-r6zml to ip-10-0-133-7.ec2.internal
(x6)

openshift-ingress

replicaset-controller

router-default-cf88d7cdf

FailedCreate

Error creating: pods "router-default-cf88d7cdf-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-cf88d7cdf from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-cf88d7cdf

FailedCreate

Error creating: pods "router-default-cf88d7cdf-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-cf88d7cdf

SuccessfulCreate

Created pod: router-default-cf88d7cdf-w5kz2
(x5)

openshift-ingress

kubelet

router-default-cf88d7cdf-w5kz2

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-cf88d7cdf-w5kz2

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-cf88d7cdf-w5kz2

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-cf88d7cdf-w5kz2

AddedInterface

Add eth0 [10.134.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-cf88d7cdf-w5kz2

Started

Started container router

openshift-ingress

kubelet

router-default-cf88d7cdf-w5kz2

Created

Created container: router

openshift-ingress

replicaset-controller

kube-auth-proxy-5c857974d4

SuccessfulCreate

Created pod: kube-auth-proxy-5c857974d4-r6zml
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5c857974d4

FailedCreate

Error creating: pods "kube-auth-proxy-5c857974d4-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5c857974d4 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5c857974d4

SuccessfulCreate

Created pod: kube-auth-proxy-5c857974d4-g2dnm

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-g2dnm

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-r6zml

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-5c857974d4-r6zml

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-hz7x2

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-r6zml

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5c857974d4-g2dnm

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hz7x2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-g2dnm

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-hz7x2

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-g2dnm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.918s (2.918s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-g2dnm

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-g2dnm

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-r6zml

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hz7x2

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hz7x2

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-r6zml

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.386s (3.386s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5c857974d4-r6zml

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hz7x2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.214s (3.214s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hz7x2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cn74bt

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hz7x2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cn74bt

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cn74bt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cn74bt

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cn74bt

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cn74bt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.786s (2.786s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-w7h2m

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-w7h2m
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-v55gs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-csc8g

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-v55gs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-v55gs

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-csc8g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-csc8g

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-csc8g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-csc8g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-csc8g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.182s (2.182s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-v55gs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-v55gs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-v55gs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.225s (2.225s including waiting). Image size: 165907129 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-w7h2m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-w7h2m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-w7h2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-w7h2m

Unhealthy

Startup probe failed: Get "http://10.132.0.23:15021/healthz/ready": dial tcp 10.132.0.23:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-w7h2m

ProbeError

Startup probe error: Get "http://10.132.0.23:15021/healthz/ready": dial tcp 10.132.0.23:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-93562a48

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-93562a48

openshift-ingress

multus

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-93562a48-openshift-default-86f77b96dd

SuccessfulCreate

Created pod: e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

openshift-ingress

deployment-controller

e2e-ait-93562a48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-93562a48-openshift-default-86f77b96dd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-93562a48-5546fb8948

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-93562a48-5546fb8948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-93562a48: serviceaccount "payload-processing-e2e-ait-93562a48" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-93562a48-5546fb8948

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-93562a48

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-93562a48-5546fb8948 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-93562a48

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-93562a48-c8997c9b4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-93562a48-c8997c9b4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-93562a48-c8997c9b4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-93562a48-c8997c9b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-93562a48: serviceaccount "payload-processing-e2e-ait-93562a48" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.845s (1.845s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.025s (2.025s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

Unhealthy

Readiness probe failed: Get "http://10.132.0.31:15021/healthz/ready": read tcp 10.132.0.2:54138->10.132.0.31:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

ProbeError

Readiness probe error: Get "http://10.132.0.31:15021/healthz/ready": read tcp 10.132.0.2:54138->10.132.0.31:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

ProbeError

Startup probe error: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

Unhealthy

Startup probe failed: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-93562a48-c8997c9b4-5c4lx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93562a48-5546fb8948-9vrh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-93562a48-openshift-default-86f77b96dd-25nqp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4

SuccessfulCreate

Created pod: e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

openshift-ingress

gateway_labeler_controller

e2e-migrate-89063c4d-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-89063c4d-gw

openshift-ingress

deployment-controller

e2e-migrate-89063c4d-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4 from 0 to 1

openshift-ingress

multus

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-89063c4d-67db47f64d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-89063c4d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-89063c4d-67db47f64d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-89063c4d-67db47f64d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-89063c4d: serviceaccount "payload-processing-e2e-migrate-89063c4d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-89063c4d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-89063c4d-57bb867777 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-89063c4d-57bb867777

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-89063c4d-57bb867777

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-89063c4d-57bb867777-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-89063c4d: serviceaccount "payload-processing-e2e-migrate-89063c4d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

Unhealthy

Readiness probe failed: Get "http://10.132.0.32:15021/healthz/ready": read tcp 10.132.0.2:38760->10.132.0.32:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

ProbeError

Readiness probe error: Get "http://10.132.0.32:15021/healthz/ready": read tcp 10.132.0.2:38760->10.132.0.32:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-89063c4d-67db47f64d-4z5fl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-89063c4d-57bb867777-5m9qn

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-88aa9015-openshift-default-7cb985f86b

SuccessfulCreate

Created pod: e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

openshift-ingress

deployment-controller

e2e-ait-88aa9015-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-88aa9015-openshift-default-7cb985f86b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-88aa9015

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-88aa9015

openshift-ingress

multus

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-88aa9015-5fccb867dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-88aa9015-7795c59bcd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-88aa9015-7795c59bcd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-88aa9015-7795c59bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-88aa9015: serviceaccount "payload-processing-e2e-ait-88aa9015" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-88aa9015

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-88aa9015-7795c59bcd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-88aa9015-5fccb867dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-88aa9015: serviceaccount "payload-processing-e2e-ait-88aa9015" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-88aa9015

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-88aa9015-5fccb867dd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

Unhealthy

Readiness probe failed: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-89063c4d-gw-openshift-default-cf78b87d4-v9sf9

ProbeError

Readiness probe error: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

ProbeError

Readiness probe error: Get "http://10.132.0.33:15021/healthz/ready": read tcp 10.132.0.2:53458->10.132.0.33:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

Unhealthy

Readiness probe failed: Get "http://10.132.0.33:15021/healthz/ready": read tcp 10.132.0.2:53458->10.132.0.33:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-88aa9015-7795c59bcd-j7dft

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-88aa9015-5fccb867dd-2qppj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-0f99172f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0f99172f-openshift-default-59764db4cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-0f99172f-openshift-default-59764db4cb

SuccessfulCreate

Created pod: e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

openshift-ingress

gateway_labeler_controller

e2e-derive-0f99172f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0f99172f

openshift-ingress

multus

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0f99172f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0f99172f-685d677d8d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0f99172f-685d677d8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0f99172f-685d677d8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0f99172f: serviceaccount "payload-processing-e2e-derive-0f99172f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0f99172f-85475c8754

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0f99172f-85475c8754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0f99172f: serviceaccount "payload-processing-e2e-derive-0f99172f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0f99172f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0f99172f-85475c8754 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0f99172f-685d677d8d-rg5mr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0f99172f-685d677d8d-rg5mr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0f99172f-685d677d8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0f99172f-685d677d8d-rg5mr

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0f99172f-85475c8754

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd

openshift-ingress

multus

payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0f99172f-685d677d8d-rg5mr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-88aa9015-openshift-default-7cb985f86b-ql4tw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

multus

payload-pre-processing-e2e-derive-0f99172f-685d677d8d-rg5mr

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0f99172f-685d677d8d-rg5mr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0f99172f-85475c8754-pfxdd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-0f99172f-openshift-default-59764db4cb-bqwfl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-bc10550f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-bc10550f

openshift-ingress

multus

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-bc10550f-openshift-default-577c7c96d4

SuccessfulCreate

Created pod: e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

openshift-ingress

deployment-controller

e2e-mt-bc10550f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-bc10550f-openshift-default-577c7c96d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bc10550f-858c5684cd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-bc10550f-858c5684cd-c94db

openshift-ingress

kubelet

payload-processing-e2e-mt-bc10550f-858c5684cd-c94db

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-gm89x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-bc10550f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-gm89x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-gm89x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-gm89x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-gm89x

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-bc10550f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-bc10550f-858c5684cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bc10550f: serviceaccount "payload-processing-e2e-mt-bc10550f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bc10550f-858c5684cd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-bc10550f-858c5684cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bc10550f: serviceaccount "payload-processing-e2e-mt-bc10550f" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-bc10550f-858c5684cd-c94db

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-bc10550f-858c5684cd-c94db

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-bc10550f-858c5684cd-c94db

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

ProbeError

Readiness probe error: Get "http://10.132.0.35:15021/healthz/ready": read tcp 10.132.0.2:59628->10.132.0.35:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

Unhealthy

Readiness probe failed: Get "http://10.132.0.35:15021/healthz/ready": read tcp 10.132.0.2:59628->10.132.0.35:15021: read: connection reset by peer
(x3)

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-gm89x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bc10550f-858c5684cd-c94db

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bc10550f-7b5d6689cb-gm89x

Unhealthy

Readiness probe failed: dial tcp 10.133.0.53:9004: i/o timeout

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-bc10550f-openshift-default-577c7c96d4-ctzs7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-mt-11cbe871

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-11cbe871

openshift-ingress

replicaset-controller

e2e-mt-11cbe871-openshift-default-cd6865c76

SuccessfulCreate

Created pod: e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

openshift-ingress

deployment-controller

e2e-mt-11cbe871-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-11cbe871-openshift-default-cd6865c76 from 0 to 1

openshift-ingress

multus

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-11cbe871-5876bd68

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-11cbe871-5876bd68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-11cbe871: serviceaccount "payload-processing-e2e-mt-11cbe871" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-11cbe871-5876bd68

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss

openshift-ingress

deployment-controller

payload-processing-e2e-mt-11cbe871

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-11cbe871-7578c864cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-11cbe871-7578c864cd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-11cbe871-7578c864cd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-11cbe871-7578c864cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-11cbe871: serviceaccount "payload-processing-e2e-mt-11cbe871" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-11cbe871

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-11cbe871-5876bd68 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

ProbeError

Readiness probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

Unhealthy

Readiness probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-11cbe871-7578c864cd-dq7wv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-11cbe871-5876bd68-jvgss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-11cbe871-openshift-default-cd6865c76-vtvxm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-dd1393-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-dd1393-openshift-default-9fc984c6b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-dd1393

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-dd1393

openshift-ingress

replicaset-controller

e2e-inf-a-dd1393-openshift-default-9fc984c6b

SuccessfulCreate

Created pod: e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

openshift-ingress

multus

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dd1393-5c8b49755d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-dd1393-5c8b49755d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dd1393: serviceaccount "payload-processing-e2e-inf-a-dd1393" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dd1393-755cc5c456

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dd1393: serviceaccount "payload-processing-e2e-inf-a-dd1393" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dd1393-755cc5c456

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-dd1393

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-dd1393-755cc5c456 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dd1393-5c8b49755d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-dd1393

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-dd1393-5c8b49755d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

Unhealthy

Readiness probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

ProbeError

Readiness probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-9aa496-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9aa496-openshift-default-8468dbc5cb from 0 to 1

openshift-ingress

multus

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9aa496

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9aa496

openshift-ingress

replicaset-controller

e2e-inf-b-9aa496-openshift-default-8468dbc5cb

SuccessfulCreate

Created pod: e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9aa496: serviceaccount "payload-processing-e2e-inf-b-9aa496" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9aa496

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9aa496-88bd4b984 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9aa496-88bd4b984

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9aa496-88bd4b984

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9aa496-88bd4b984-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9aa496: serviceaccount "payload-processing-e2e-inf-b-9aa496" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9aa496

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

Unhealthy

Readiness probe failed: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

ProbeError

Readiness probe error: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dd1393-5c8b49755d-4stpx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dd1393-755cc5c456-mpkw7

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-dd1393

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-dd1393": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-dd1393, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9a4914bd-c4e9-4fce-b38f-bd6c521bf560, UID in object meta:

openshift-ingress

kubelet

e2e-inf-a-dd1393-openshift-default-9fc984c6b-c97mt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9aa496-67fcdc7f56-nqkxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9aa496-88bd4b984-gs65p

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-api-a-4b144e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4b144e-openshift-default-6d96c5797b from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-9aa496-openshift-default-8468dbc5cb-xfpjz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-4b144e-openshift-default-6d96c5797b

SuccessfulCreate

Created pod: e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

openshift-ingress

gateway_labeler_controller

e2e-api-a-4b144e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4b144e

openshift-ingress

multus

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4b144e-bf7cc768d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4b144e-bf7cc768d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4b144e-bf7cc768d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4b144e: serviceaccount "payload-processing-e2e-api-a-4b144e" not found

openshift-ingress

multus

payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4b144e-7b76f8c496

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4b144e: serviceaccount "payload-processing-e2e-api-a-4b144e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4b144e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4b144e-bf7cc768d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4b144e-7b76f8c496

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4b144e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4b144e-7b76f8c496 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

Unhealthy

Readiness probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

ProbeError

Readiness probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-e87d49-openshift-default-f94fddcd8

SuccessfulCreate

Created pod: e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

openshift-ingress

deployment-controller

e2e-api-b-e87d49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-e87d49-openshift-default-f94fddcd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-e87d49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-e87d49
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e87d49-68b6455dd

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-e87d49-68b6455dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e87d49: serviceaccount "payload-processing-e2e-api-b-e87d49" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e87d49-58bbbbd988

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e87d49: serviceaccount "payload-processing-e2e-api-b-e87d49" not found

openshift-ingress

multus

payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-e87d49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-e87d49-58bbbbd988 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-e87d49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-e87d49-68b6455dd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e87d49-58bbbbd988

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e87d49-68b6455dd

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w

openshift-ingress

kubelet

payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b144e-bf7cc768d-v7zgf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b144e-7b76f8c496-vj5bz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-4b144e-openshift-default-6d96c5797b-bfz9d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e87d49-58bbbbd988-n56wv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-e87d49-68b6455dd-nvg9w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-e87d49-openshift-default-f94fddcd8-8qgxd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-50e693-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-50e693-openshift-default-75fdf78ff6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-50e693

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-50e693

openshift-ingress

replicaset-controller

e2e-shared-a-50e693-openshift-default-75fdf78ff6

SuccessfulCreate

Created pod: e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

openshift-ingress

multus

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-50e693: serviceaccount "payload-processing-e2e-shared-a-50e693" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-50e693-67f474d4db

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-50e693-67f474d4db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-50e693: serviceaccount "payload-processing-e2e-shared-a-50e693" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-50e693

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-50e693-67f474d4db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-50e693-67f474d4db

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-50e693

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8-2mtt4

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8-2mtt4

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8-2mtt4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8-2mtt4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8-2mtt4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-1e6a9b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-1e6a9b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-1e6a9b

openshift-ingress

replicaset-controller

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd

SuccessfulCreate

Created pod: e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

openshift-ingress

multus

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-1e6a9b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-1e6a9b-757d64b94b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-1e6a9b-757d64b94b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-1e6a9b-757d64b94b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-1e6a9b: serviceaccount "payload-processing-e2e-shared-b-1e6a9b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-1e6a9b: serviceaccount "payload-processing-e2e-shared-b-1e6a9b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-1e6a9b-757d64b94b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-1e6a9b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-a-aab086-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-aab086-openshift-default-6d8cc8986 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-aab086

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-aab086

openshift-ingress

replicaset-controller

e2e-ipp-a-aab086-openshift-default-6d8cc8986

SuccessfulCreate

Created pod: e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz

openshift-ingress

multus

e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-aab086-c57bbfc66

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-aab086: serviceaccount "payload-processing-e2e-ipp-a-aab086" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-aab086

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-aab086-c57bbfc66

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-aab086-c57bbfc66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-aab086: serviceaccount "payload-processing-e2e-ipp-a-aab086" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-aab086

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-aab086-c57bbfc66 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4

SuccessfulCreate

Created pod: e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-04c3b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-04c3b9

openshift-ingress

deployment-controller

e2e-ipp-b-04c3b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-04c3b9-openshift-default-54595bbbc4 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6-fnq6c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-04c3b9: serviceaccount "payload-processing-e2e-ipp-b-04c3b9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-04c3b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d-wf6ws
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-04c3b9: serviceaccount "payload-processing-e2e-ipp-b-04c3b9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-04c3b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d-wf6ws

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6-fnq6c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d-wf6ws

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d-wf6ws

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6-fnq6c

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d-wf6ws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6-fnq6c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6-fnq6c

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

openshift-ingress

deployment-controller

e2e-ipp-cleanup-43705a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-43705a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-43705a

openshift-ingress

multus

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.243s (3.243s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-43705a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-43705a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4-wssxm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-43705a: serviceaccount "payload-processing-e2e-ipp-cleanup-43705a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4-wssxm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4-wssxm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4-wssxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4-wssxm

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-43705a: serviceaccount "payload-processing-e2e-ipp-cleanup-43705a" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-43705a-7bcb4798d4-wssxm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-43705a-648b76bbd8-bkjpg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-43705a-openshift-default-f48db7bbd-jbtj4

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-aab086

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-aab086": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-aab086, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c19b9a0c-a08d-4923-9198-9076d0222915, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-aab086-c57bbfc66-qhjvp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-aab086-c6b7b7fcb-qtvpl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-aab086-openshift-default-6d8cc8986-8s9nz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-04c3b9-5554d46df6-fnq6c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-04c3b9-5f58c78b7d-wf6ws

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-04c3b9-openshift-default-54595bbbc4-t7ct4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-50e693-67f474d4db-cwvwh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-50e693-55cff4bdd8-2mtt4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-50e693-openshift-default-75fdf78ff6-fhlc5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1e6a9b-7b86577dd4-dwb4p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1e6a9b-757d64b94b-zzxbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-1e6a9b-openshift-default-5bcfdcdfbd-flpld

Killing

Stopping container istio-proxy