Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b-4twrh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b-4twrh to ip-10-0-143-204.ec2.internal

openshift-ingress

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx to ip-10-0-131-103.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd-q4vcz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd-q4vcz to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-bbfced-66f6b5cd6-w4kcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-bbfced-66f6b5cd6-w4kcf to ip-10-0-143-204.ec2.internal

openshift-ingress

e2e-shared-b-938af8-openshift-default-698486947b-d9vgc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-938af8-openshift-default-698486947b-d9vgc to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-e2e-derive-8fc7075e-679f79b654-sw6gk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-8fc7075e-679f79b654-sw6gk to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc to ip-10-0-131-103.ec2.internal

openshift-ingress

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-bbfced-66d69df748-ghzss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-bbfced-66d69df748-ghzss to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-8fc7075e-764c57996-mcpm6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-8fc7075e-764c57996-mcpm6 to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-e2e-ait-600fea54-7f554c49fd-kcfst

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-600fea54-7f554c49fd-kcfst to ip-10-0-143-204.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-25j98

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98 to ip-10-0-131-103.ec2.internal

openshift-ingress

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

Scheduled

Successfully assigned openshift-ingress/e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d to ip-10-0-143-204.ec2.internal

openshift-ingress

kube-auth-proxy-7dc46bdfb5-94swf

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf to ip-10-0-132-200.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h to ip-10-0-131-103.ec2.internal

openshift-ingress

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4 to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-nftmt

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-nftmt to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5 to ip-10-0-131-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-45b6b7-665995c6dd-57mp8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-45b6b7-665995c6dd-57mp8 to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-aa51de-8469595848-b7pjd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-aa51de-8469595848-b7pjd to ip-10-0-143-204.ec2.internal

openshift-ingress

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-106097-8595d46896-jz46n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n to ip-10-0-131-103.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz to ip-10-0-131-103.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr to ip-10-0-131-103.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-a7e2221a-54ddb77b49-z7tl8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-a7e2221a-54ddb77b49-z7tl8 to ip-10-0-143-204.ec2.internal

openshift-ingress

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-e2e-mt-676e8e92-5c4c7bf66b-tbwn5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-676e8e92-5c4c7bf66b-tbwn5 to ip-10-0-143-204.ec2.internal

openshift-ingress

kube-auth-proxy-7dc46bdfb5-c5vvx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx to ip-10-0-131-103.ec2.internal

openshift-ingress

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc to ip-10-0-143-204.ec2.internal

openshift-ingress

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-600fea54-8c856b68-9sw89

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-600fea54-8c856b68-9sw89 to ip-10-0-143-204.ec2.internal

openshift-ingress

e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b to ip-10-0-131-103.ec2.internal

openshift-ingress

e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn to ip-10-0-131-103.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2 to ip-10-0-131-103.ec2.internal

openshift-ingress

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

Scheduled

Successfully assigned openshift-ingress/e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56-5q82z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56-5q82z to ip-10-0-143-204.ec2.internal

openshift-ingress

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q to ip-10-0-131-103.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-wvhr9

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wvhr9 to ip-10-0-143-204.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-qkcrn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qkcrn to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48-rdwmf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48-rdwmf to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4-89vtm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4-89vtm to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428 to ip-10-0-131-103.ec2.internal

openshift-ingress

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8 to ip-10-0-143-204.ec2.internal

openshift-ingress

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-676e8e92-7f4649f748-4vf6z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-676e8e92-7f4649f748-4vf6z to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-94af13-5846ffbcdb-n9w9r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-94af13-5846ffbcdb-n9w9r to ip-10-0-143-204.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5 to ip-10-0-131-103.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-rsm9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-rsm9z to ip-10-0-143-204.ec2.internal

openshift-ingress

router-default-7c6777bc7-kmtdh

Scheduled

Successfully assigned openshift-ingress/router-default-7c6777bc7-kmtdh to ip-10-0-132-200.ec2.internal
(x6)

openshift-ingress

replicaset-controller

router-default-7c6777bc7

FailedCreate

Error creating: pods "router-default-7c6777bc7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7c6777bc7 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-7c6777bc7

FailedCreate

Error creating: pods "router-default-7c6777bc7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7c6777bc7

SuccessfulCreate

Created pod: router-default-7c6777bc7-kmtdh
(x6)

openshift-ingress

kubelet

router-default-7c6777bc7-kmtdh

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-7c6777bc7-kmtdh

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-7c6777bc7-kmtdh

Started

Started container router

openshift-ingress

kubelet

router-default-7c6777bc7-kmtdh

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-7c6777bc7-kmtdh

Created

Created container: router

openshift-ingress

multus

router-default-7c6777bc7-kmtdh

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7dc46bdfb5

SuccessfulCreate

Created pod: kube-auth-proxy-7dc46bdfb5-94swf

openshift-ingress

replicaset-controller

kube-auth-proxy-7dc46bdfb5

SuccessfulCreate

Created pod: kube-auth-proxy-7dc46bdfb5-c5vvx
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-7dc46bdfb5

FailedCreate

Error creating: pods "kube-auth-proxy-7dc46bdfb5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7dc46bdfb5 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-7dc46bdfb5-c5vvx

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7dc46bdfb5-c5vvx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7dc46bdfb5-94swf

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7dc46bdfb5-94swf

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-25j98

openshift-ingress

kubelet

kube-auth-proxy-7dc46bdfb5-94swf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.551s (2.551s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7dc46bdfb5-94swf

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7dc46bdfb5-94swf

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7dc46bdfb5-c5vvx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7dc46bdfb5-c5vvx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7dc46bdfb5-c5vvx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.756s (2.756s including waiting). Image size: 265120132 bytes.

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-25j98

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-25j98

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-25j98

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-25j98

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-25j98

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.53s (2.53s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-25j98

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-wvhr9

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-25j98

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-wvhr9

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wvhr9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wvhr9

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wvhr9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.431s (3.431s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wvhr9

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-qkcrn

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-qkcrn

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-nftmt

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-rsm9z
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-rsm9z

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-rsm9z

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-nftmt

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-nftmt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-rsm9z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-nftmt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.109s (2.109s including waiting). Image size: 165776054 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-nftmt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-rsm9z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-rsm9z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.161s (2.161s including waiting). Image size: 165776054 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-nftmt

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qkcrn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qkcrn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qkcrn

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qkcrn

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qkcrn

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-600fea54

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-600fea54

openshift-ingress

deployment-controller

e2e-ait-600fea54-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-600fea54-openshift-default-6d5d895678 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-600fea54-openshift-default-6d5d895678

SuccessfulCreate

Created pod: e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

openshift-ingress

multus

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-600fea54-8c856b68

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-600fea54-8c856b68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-600fea54: serviceaccount "payload-processing-e2e-ait-600fea54" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-600fea54-8c856b68

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-600fea54-8c856b68-9sw89
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-600fea54-7f554c49fd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-600fea54-7f554c49fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-600fea54: serviceaccount "payload-processing-e2e-ait-600fea54" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-600fea54-7f554c49fd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-600fea54-7f554c49fd-kcfst

openshift-ingress

deployment-controller

payload-processing-e2e-ait-600fea54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-600fea54-7f554c49fd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-600fea54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-600fea54-8c856b68 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-600fea54-8c856b68-9sw89

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-600fea54-7f554c49fd-kcfst

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-600fea54-8c856b68-9sw89

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-600fea54-7f554c49fd-kcfst

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-600fea54-8c856b68-9sw89

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-600fea54-8c856b68-9sw89

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-600fea54-7f554c49fd-kcfst

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-600fea54-7f554c49fd-kcfst

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-600fea54

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-600fea54: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-600fea54": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-600fea54, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ee6013bf-d8e9-48b3-a162-928e7f1f053a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-600fea54-8c856b68-9sw89

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-600fea54-7f554c49fd-kcfst

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-600fea54-openshift-default-6d5d895678-mh6qv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-a7e2221a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-a7e2221a-gw

openshift-ingress

deployment-controller

e2e-migrate-a7e2221a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-a7e2221a-gw-openshift-default-5658768d from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-a7e2221a-gw-openshift-default-5658768d

SuccessfulCreate

Created pod: e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

openshift-ingress

multus

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-a7e2221a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-a7e2221a-54ddb77b49 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a7e2221a-54ddb77b49

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-a7e2221a-54ddb77b49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a7e2221a: serviceaccount "payload-processing-e2e-migrate-a7e2221a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-a7e2221a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4-89vtm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-a7e2221a: serviceaccount "payload-processing-e2e-migrate-a7e2221a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-a7e2221a-54ddb77b49

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-a7e2221a-54ddb77b49-z7tl8

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4-89vtm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-a7e2221a-54ddb77b49-z7tl8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-a7e2221a-54ddb77b49-z7tl8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a7e2221a-54ddb77b49-z7tl8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-a7e2221a-54ddb77b49-z7tl8

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4-89vtm

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4-89vtm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4-89vtm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:42188->10.133.0.51:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:42188->10.133.0.51:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-a7e2221a-6bfd8f65d4-89vtm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-a7e2221a-54ddb77b49-z7tl8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-a7e2221a-gw-openshift-default-5658768d-wqwz4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-1f2fc6f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1f2fc6f2-openshift-default-6c979fc776 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-1f2fc6f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1f2fc6f2

openshift-ingress

replicaset-controller

e2e-ait-1f2fc6f2-openshift-default-6c979fc776

SuccessfulCreate

Created pod: e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

openshift-ingress

multus

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1f2fc6f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1f2fc6f2: serviceaccount "payload-processing-e2e-ait-1f2fc6f2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1f2fc6f2: serviceaccount "payload-processing-e2e-ait-1f2fc6f2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56-5q82z

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd-q4vcz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1f2fc6f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd-q4vcz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd-q4vcz

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56-5q82z

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56-5q82z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd-q4vcz

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd-q4vcz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56-5q82z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56-5q82z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-1f2fc6f2-5dd5849dbd-q4vcz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1f2fc6f2-b466dcc56-5q82z

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-1f2fc6f2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-1f2fc6f2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-1f2fc6f2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-1f2fc6f2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b4e1e6ca-cda1-41a1-9c23-f8dbbe4d1476, UID in object meta:

openshift-ingress

gateway_labeler_controller

e2e-derive-8fc7075e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-8fc7075e

openshift-ingress

deployment-controller

e2e-derive-8fc7075e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-8fc7075e-openshift-default-5f7cc97864 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-8fc7075e-openshift-default-5f7cc97864

SuccessfulCreate

Created pod: e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

openshift-ingress

kubelet

e2e-ait-1f2fc6f2-openshift-default-6c979fc776-jtmqm

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-8fc7075e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-8fc7075e-679f79b654 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-8fc7075e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-8fc7075e-764c57996 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8fc7075e-764c57996

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-8fc7075e-764c57996-mcpm6

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8fc7075e-764c57996-mcpm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-8fc7075e-679f79b654-sw6gk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8fc7075e-764c57996

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-8fc7075e-764c57996-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8fc7075e: serviceaccount "payload-processing-e2e-derive-8fc7075e" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-8fc7075e-679f79b654-sw6gk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8fc7075e-764c57996-mcpm6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8fc7075e-764c57996-mcpm6

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8fc7075e-679f79b654

SuccessfulCreate

Created pod: payload-processing-e2e-derive-8fc7075e-679f79b654-sw6gk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8fc7075e-679f79b654

FailedCreate

Error creating: pods "payload-processing-e2e-derive-8fc7075e-679f79b654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8fc7075e: serviceaccount "payload-processing-e2e-derive-8fc7075e" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-8fc7075e-764c57996-mcpm6

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-8fc7075e-679f79b654-sw6gk

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-8fc7075e-679f79b654-sw6gk

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8fc7075e-764c57996-mcpm6

Unhealthy

Readiness probe failed: dial tcp 10.133.0.58:9004: connect: connection refused

openshift-ingress

kubelet

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-8fc7075e-679f79b654-sw6gk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8fc7075e-764c57996-mcpm6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-8fc7075e-openshift-default-5f7cc97864-7htgj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-89fed8b8-openshift-default-595c55bf6d

SuccessfulCreate

Created pod: e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

openshift-ingress

deployment-controller

e2e-mt-89fed8b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-89fed8b8-openshift-default-595c55bf6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-89fed8b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-89fed8b8

openshift-ingress

multus

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-89fed8b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b-4twrh

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48-rdwmf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-89fed8b8: serviceaccount "payload-processing-e2e-mt-89fed8b8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48-rdwmf

openshift-ingress

multus

payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48-rdwmf

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b-4twrh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b-4twrh

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-89fed8b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-89fed8b8: serviceaccount "payload-processing-e2e-mt-89fed8b8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48-rdwmf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b-4twrh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b-4twrh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48-rdwmf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89fed8b8-8f87bdb48-rdwmf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-89fed8b8-7bb9c7dc8b-4twrh

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-89fed8b8-openshift-default-595c55bf6d-8xp2d

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-676e8e92

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-676e8e92

openshift-ingress

deployment-controller

e2e-mt-676e8e92-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-676e8e92-openshift-default-5cb9d9f5b8 from 0 to 1

openshift-ingress

multus

e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-676e8e92-openshift-default-5cb9d9f5b8

SuccessfulCreate

Created pod: e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx

openshift-ingress

deployment-controller

payload-processing-e2e-mt-676e8e92

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-676e8e92-5c4c7bf66b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-676e8e92-5c4c7bf66b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-676e8e92-5c4c7bf66b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-676e8e92: serviceaccount "payload-processing-e2e-mt-676e8e92" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-676e8e92-5c4c7bf66b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-676e8e92-5c4c7bf66b-tbwn5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-676e8e92-7f4649f748

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-676e8e92-7f4649f748-4vf6z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-676e8e92

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-676e8e92-7f4649f748 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-676e8e92-7f4649f748

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-676e8e92-7f4649f748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-676e8e92: serviceaccount "payload-processing-e2e-mt-676e8e92" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-676e8e92-5c4c7bf66b-tbwn5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-676e8e92-5c4c7bf66b-tbwn5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-676e8e92-5c4c7bf66b-tbwn5

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-676e8e92-5c4c7bf66b-tbwn5

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-676e8e92-7f4649f748-4vf6z

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-676e8e92-7f4649f748-4vf6z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-676e8e92-7f4649f748-4vf6z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-676e8e92-7f4649f748-4vf6z

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-676e8e92-7f4649f748-4vf6z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-676e8e92-5c4c7bf66b-tbwn5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-676e8e92-openshift-default-5cb9d9f5b8-dp5wx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-bbfced-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-bbfced-openshift-default-696cfbf7db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-bbfced

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-bbfced

openshift-ingress

multus

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-bbfced-openshift-default-696cfbf7db

SuccessfulCreate

Created pod: e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-bbfced

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-bbfced-66d69df748 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-bbfced

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-bbfced-66f6b5cd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bbfced-66f6b5cd6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-bbfced-66f6b5cd6-w4kcf

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bbfced-66d69df748-ghzss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bbfced-66d69df748-ghzss

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bbfced-66d69df748-ghzss

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bbfced-66f6b5cd6-w4kcf

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bbfced-66d69df748

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-bbfced-66d69df748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bbfced: serviceaccount "payload-processing-e2e-inf-a-bbfced" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bbfced-66d69df748

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-bbfced-66d69df748-ghzss

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-bbfced-66d69df748-ghzss

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bbfced-66f6b5cd6-w4kcf

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bbfced-66f6b5cd6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-bbfced-66f6b5cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bbfced: serviceaccount "payload-processing-e2e-inf-a-bbfced" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-bbfced-66f6b5cd6-w4kcf

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bbfced-66f6b5cd6-w4kcf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-aa51de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-aa51de

openshift-ingress

deployment-controller

e2e-inf-b-aa51de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-aa51de-openshift-default-57c8ddff94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-aa51de-openshift-default-57c8ddff94

SuccessfulCreate

Created pod: e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-inf-b-aa51de-openshift-default-dockercfg-khndj); attempting to pull the image may not succeed.

openshift-ingress

multus

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-aa51de-b4d894f74

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-aa51de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-aa51de-8469595848 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-aa51de-8469595848

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-aa51de-8469595848-b7pjd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-aa51de-8469595848

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-aa51de-8469595848-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-aa51de: serviceaccount "payload-processing-e2e-inf-b-aa51de" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-aa51de-b4d894f74

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-aa51de-b4d894f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-aa51de: serviceaccount "payload-processing-e2e-inf-b-aa51de" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-aa51de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-aa51de-b4d894f74 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-aa51de-8469595848-b7pjd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-aa51de-8469595848-b7pjd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-aa51de-8469595848-b7pjd

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-aa51de-8469595848-b7pjd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.62s (1.62s including waiting). Image size: 165776054 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

Unhealthy

Readiness probe failed: Get "http://10.133.0.69:15021/healthz/ready": read tcp 10.133.0.2:52380->10.133.0.69:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

ProbeError

Readiness probe error: Get "http://10.133.0.69:15021/healthz/ready": read tcp 10.133.0.2:52380->10.133.0.69:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bbfced-66d69df748-ghzss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bbfced-66f6b5cd6-w4kcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-bbfced-openshift-default-696cfbf7db-stjdq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-aa51de-8469595848-b7pjd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-aa51de-openshift-default-57c8ddff94-z4rhx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-api-a-e7d231-openshift-default-7c5c8885c6

SuccessfulCreate

Created pod: e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

openshift-ingress

deployment-controller

e2e-api-a-e7d231-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e7d231-openshift-default-7c5c8885c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-e7d231

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e7d231

openshift-ingress

multus

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e7d231-6bb47d5984

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e7d231

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e7d231-fff85b57b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e7d231-fff85b57b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e7d231-fff85b57b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e7d231-fff85b57b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e7d231: serviceaccount "payload-processing-e2e-api-a-e7d231" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e7d231-6bb47d5984

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e7d231-6bb47d5984-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e7d231: serviceaccount "payload-processing-e2e-api-a-e7d231" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e7d231

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e7d231-6bb47d5984 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-45b6b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-45b6b7-openshift-default-79c8fd5dcd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd

SuccessfulCreate

Created pod: e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

openshift-ingress

gateway_labeler_controller

e2e-api-b-45b6b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-45b6b7

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-45b6b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-45b6b7-68fdd9bc74 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-45b6b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-45b6b7-665995c6dd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-45b6b7-68fdd9bc74

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-45b6b7-68fdd9bc74

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-45b6b7-68fdd9bc74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-45b6b7: serviceaccount "payload-processing-e2e-api-b-45b6b7" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-45b6b7-665995c6dd-57mp8

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-45b6b7-665995c6dd-57mp8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-45b6b7-665995c6dd-57mp8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-45b6b7-665995c6dd-57mp8

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-45b6b7-665995c6dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-45b6b7-665995c6dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-45b6b7: serviceaccount "payload-processing-e2e-api-b-45b6b7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-45b6b7-665995c6dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-45b6b7-665995c6dd-57mp8

openshift-ingress

kubelet

payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": read tcp 10.133.0.2:56684->10.133.0.71:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": read tcp 10.133.0.2:56684->10.133.0.71:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-e7d231-openshift-default-7c5c8885c6-cwn9w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-45b6b7-665995c6dd-57mp8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-94af13-openshift-default-6f55dd6dd8

SuccessfulCreate

Created pod: e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

openshift-ingress

gateway_labeler_controller

e2e-shared-a-94af13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-94af13

openshift-ingress

deployment-controller

e2e-shared-a-94af13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-94af13-openshift-default-6f55dd6dd8 from 0 to 1

openshift-ingress

multus

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-45b6b7-openshift-default-79c8fd5dcd-hswx8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-94af13-5846ffbcdb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-94af13-5846ffbcdb-n9w9r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-94af13-68fc497cd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-94af13: serviceaccount "payload-processing-e2e-shared-a-94af13" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-94af13-68fc497cd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-94af13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-94af13-68fc497cd4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-94af13-5846ffbcdb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-94af13-5846ffbcdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-94af13: serviceaccount "payload-processing-e2e-shared-a-94af13" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-94af13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-94af13-5846ffbcdb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-94af13-5846ffbcdb-n9w9r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-94af13-5846ffbcdb-n9w9r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-94af13-5846ffbcdb-n9w9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-94af13-5846ffbcdb-n9w9r

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-938af8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-938af8

openshift-ingress

deployment-controller

e2e-shared-b-938af8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-938af8-openshift-default-698486947b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-938af8-openshift-default-698486947b

SuccessfulCreate

Created pod: e2e-shared-b-938af8-openshift-default-698486947b-d9vgc

openshift-ingress

multus

e2e-shared-b-938af8-openshift-default-698486947b-d9vgc

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-938af8-6ffd96d6c4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5

openshift-ingress

multus

payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-938af8-57c4bc587b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-938af8: serviceaccount "payload-processing-e2e-shared-b-938af8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-938af8-57c4bc587b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-938af8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-938af8-57c4bc587b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-938af8-6ffd96d6c4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-938af8-6ffd96d6c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-938af8: serviceaccount "payload-processing-e2e-shared-b-938af8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-938af8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-938af8-6ffd96d6c4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": read tcp 10.133.0.2:46538->10.133.0.74:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": read tcp 10.133.0.2:46538->10.133.0.74:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-938af8-openshift-default-698486947b-d9vgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-938af8-openshift-default-698486947b-d9vgc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-938af8-openshift-default-698486947b-d9vgc

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-938af8-openshift-default-698486947b-d9vgc

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-938af8-openshift-default-698486947b-d9vgc

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-106097-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-106097-openshift-default-f6f586c4d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-106097-openshift-default-f6f586c4d

SuccessfulCreate

Created pod: e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-106097

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-106097

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-106097-85b8b676b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-106097-8595d46896-jz46n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-106097

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-106097-85b8b676b8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-106097-8595d46896-jz46n

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-106097-8595d46896

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-106097-8595d46896-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-106097: serviceaccount "payload-processing-e2e-ipp-a-106097" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-106097-8595d46896

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-106097-8595d46896-jz46n

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-106097

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-106097-8595d46896 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-106097-85b8b676b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-106097: serviceaccount "payload-processing-e2e-ipp-a-106097" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-106097-8595d46896-jz46n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-106097-8595d46896-jz46n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn

Unhealthy

Readiness probe failed: dial tcp 10.134.0.66:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-fde43a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-fde43a

openshift-ingress

replicaset-controller

e2e-ipp-b-fde43a-openshift-default-589cd77d78

SuccessfulCreate

Created pod: e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

openshift-ingress

deployment-controller

e2e-ipp-b-fde43a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-fde43a-openshift-default-589cd77d78 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-fde43a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-fde43a-785b557574 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-fde43a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fde43a-785b557574

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-fde43a-785b557574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fde43a: serviceaccount "payload-processing-e2e-ipp-b-fde43a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fde43a-785b557574

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fde43a: serviceaccount "payload-processing-e2e-ipp-b-fde43a" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-57f095-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-57f095

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-57f095

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-57f095

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095: serviceaccount "payload-processing-e2e-ipp-cleanup-57f095" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095: serviceaccount "payload-processing-e2e-ipp-cleanup-57f095" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-57f095

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

ProbeError

Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

Unhealthy

Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-57f095

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-57f095": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 751fe81a-c8cb-46ee-99fc-338df2e007bb, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-cleanup-57f095-openshift-default-6fcc8568c6-nq5dh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-106097-8595d46896-jz46n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-106097-openshift-default-f6f586c4d-lbttc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-fde43a-openshift-default-589cd77d78-2tkxc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-94af13-5846ffbcdb-n9w9r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-94af13-openshift-default-6f55dd6dd8-ktw4j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-938af8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-938af8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-938af8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-938af8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 60ff1128-e2a1-4661-8f9e-a2f415017926, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-938af8-openshift-default-698486947b-d9vgc

Killing

Stopping container istio-proxy