Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-gt5jn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-gt5jn to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948-8t4jq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948-8t4jq to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd-mvjlf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd-mvjlf to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2 to ip-10-0-129-107.ec2.internal

openshift-ingress

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-accf7d-6b5cfb689b-rv6dp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-accf7d-6b5cfb689b-rv6dp to ip-10-0-129-107.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e9d45d7a-7b8d7487fd-97bdl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e9d45d7a-7b8d7487fd-97bdl to ip-10-0-129-107.ec2.internal

openshift-ingress

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd-4vwlt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd-4vwlt to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6-z8lz5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6-z8lz5 to ip-10-0-129-107.ec2.internal

openshift-ingress

e2e-shared-a-a60880-openshift-default-6bf448584-khph7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-a60880-openshift-default-6bf448584-khph7 to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-zx6xj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-zx6xj to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-fb0399-68bbd99f48-th924

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fb0399-68bbd99f48-th924 to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6488bc-6dbf565b78-5cptz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6488bc-6dbf565b78-5cptz to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58-xc6pr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58-xc6pr to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9 to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-9a86149a-55845dc9fc-m8d49

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-9a86149a-55845dc9fc-m8d49 to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-2f25c52f-7c96c64544-bbftd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2f25c52f-7c96c64544-bbftd to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-59d5db-65b8f8c948-qbx6l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-59d5db-65b8f8c948-qbx6l to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2 to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-derive-ac4a75bf-6dcf95dd86-7k5pr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ac4a75bf-6dcf95dd86-7k5pr to ip-10-0-129-107.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-p4wng

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng to ip-10-0-136-162.ec2.internal

openshift-ingress

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6757cc40-5475cd9994-qsd62

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6757cc40-5475cd9994-qsd62 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb-hn8b8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb-hn8b8 to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-dc9ec3-b47cd6f6b-k2l78

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-dc9ec3-b47cd6f6b-k2l78 to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts to ip-10-0-129-107.ec2.internal

openshift-ingress

e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cd17a221-8657c965cd-jb7v5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cd17a221-8657c965cd-jb7v5 to ip-10-0-128-101.ec2.internal

openshift-ingress

router-default-7bb4465977-m9lgt

Scheduled

Successfully assigned openshift-ingress/router-default-7bb4465977-m9lgt to ip-10-0-136-162.ec2.internal

openshift-ingress

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb-m48mz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb-m48mz to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-accf7d-755887b768-nzs78

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-accf7d-755887b768-nzs78 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6-z6vtf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6-z6vtf to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-processing-e2e-ait-2f25c52f-7c8bcfccfd-p4gj9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2f25c52f-7c8bcfccfd-p4gj9 to ip-10-0-129-107.ec2.internal

openshift-ingress

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj to ip-10-0-136-162.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-srr62

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-srr62 to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6 to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6757cc40-84997b996-tnxp2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6757cc40-84997b996-tnxp2 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-df4hx

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-df4hx to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-601aa9-78687d6f44-d7rqb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-601aa9-78687d6f44-d7rqb to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-a60880-7846f4db76-nc6j5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-a60880-7846f4db76-nc6j5 to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764-lc6jh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764-lc6jh to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cd17a221-65f777c97b-2mz2l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cd17a221-65f777c97b-2mz2l to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44-7bm4j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44-7bm4j to ip-10-0-129-107.ec2.internal

openshift-ingress

e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k to ip-10-0-129-107.ec2.internal

openshift-ingress

kube-auth-proxy-7b6ffddf6-pc545

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7b6ffddf6-pc545 to ip-10-0-129-107.ec2.internal

openshift-ingress

kube-auth-proxy-7b6ffddf6-tcktk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7b6ffddf6-tcktk to ip-10-0-128-101.ec2.internal

openshift-ingress

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x to ip-10-0-136-162.ec2.internal

openshift-ingress

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq to ip-10-0-129-107.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-a60880-6c5fff5886-mcrkd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-a60880-6c5fff5886-mcrkd to ip-10-0-128-101.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-601aa9-685f844dfd-fljl2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-601aa9-685f844dfd-fljl2 to ip-10-0-128-101.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7bb4465977 from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-7bb4465977

FailedCreate

Error creating: pods "router-default-7bb4465977-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-7bb4465977

FailedCreate

Error creating: pods "router-default-7bb4465977-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7bb4465977

SuccessfulCreate

Created pod: router-default-7bb4465977-m9lgt
(x5)

openshift-ingress

kubelet

router-default-7bb4465977-m9lgt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7bb4465977-m9lgt

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-7bb4465977-m9lgt

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7bb4465977-m9lgt

Started

Started container router

openshift-ingress

kubelet

router-default-7bb4465977-m9lgt

Created

Created container: router

openshift-ingress

kubelet

router-default-7bb4465977-m9lgt

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-7b6ffddf6

SuccessfulCreate

Created pod: kube-auth-proxy-7b6ffddf6-tcktk

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7b6ffddf6 from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7b6ffddf6

FailedCreate

Error creating: pods "kube-auth-proxy-7b6ffddf6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-7b6ffddf6-tcktk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7b6ffddf6-tcktk

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7b6ffddf6-pc545

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7b6ffddf6-pc545

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7b6ffddf6

SuccessfulCreate

Created pod: kube-auth-proxy-7b6ffddf6-pc545

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-7b6ffddf6-pc545

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7b6ffddf6-pc545

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7b6ffddf6-pc545

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.013s (2.013s including waiting). Image size: 265120132 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-srr62

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-srr62

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-srr62

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7b6ffddf6-tcktk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.566s (4.566s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7b6ffddf6-tcktk

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7b6ffddf6-tcktk

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-srr62

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.185s (4.185s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-srr62

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-srr62

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.576s (2.576s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-p4wng

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-p4wng

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-df4hx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-df4hx

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zx6xj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-zx6xj

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-zx6xj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5cc6cd444b-df4hx

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zx6xj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zx6xj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-zx6xj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.345s (1.345s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-df4hx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.457s (2.457s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-df4hx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-df4hx

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4wng

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4wng

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4wng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4wng

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4wng

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-e9d45d7a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e9d45d7a

openshift-ingress

deployment-controller

e2e-ait-e9d45d7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e9d45d7a-openshift-default-5f4898764b from 0 to 1

openshift-ingress

multus

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-e9d45d7a-openshift-default-5f4898764b

SuccessfulCreate

Created pod: e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e9d45d7a: serviceaccount "payload-processing-e2e-ait-e9d45d7a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e9d45d7a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e9d45d7a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e9d45d7a-7b8d7487fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e9d45d7a-7b8d7487fd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e9d45d7a-7b8d7487fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e9d45d7a: serviceaccount "payload-processing-e2e-ait-e9d45d7a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6-z8lz5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6-z8lz5

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6-z8lz5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e9d45d7a-7b8d7487fd-97bdl

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-e9d45d7a-7b8d7487fd-97bdl

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e9d45d7a-7b8d7487fd-97bdl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e9d45d7a-7b8d7487fd-97bdl

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e9d45d7a-7b8d7487fd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e9d45d7a-7b8d7487fd-97bdl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6-z8lz5

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6-z8lz5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-e9d45d7a-7b8d7487fd-97bdl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9d45d7a-569fd69ff6-z8lz5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-9a86149a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-9a86149a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-9a86149a-gw

openshift-ingress

replicaset-controller

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8

SuccessfulCreate

Created pod: e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.342s (3.342s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9a86149a-55845dc9fc

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-9a86149a-55845dc9fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9a86149a: serviceaccount "payload-processing-e2e-migrate-9a86149a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9a86149a-55845dc9fc

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-9a86149a-55845dc9fc-m8d49

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-9a86149a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44-7bm4j
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9a86149a: serviceaccount "payload-processing-e2e-migrate-9a86149a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-9a86149a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-9a86149a-55845dc9fc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44-7bm4j

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-9a86149a-55845dc9fc-m8d49

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-9a86149a-55845dc9fc-m8d49

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-9a86149a-55845dc9fc-m8d49

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-9a86149a-55845dc9fc-m8d49

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44-7bm4j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44-7bm4j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44-7bm4j

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-9a86149a-55845dc9fc-m8d49

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9a86149a-66fd5fd44-7bm4j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-9a86149a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-9a86149a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-9a86149a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-9a86149a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9032d8db-b50f-4fc2-9bca-7a5a3300e4a7, UID in object meta:

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

multus

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-2f25c52f-openshift-default-f6784b954

SuccessfulCreate

Created pod: e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

openshift-ingress

deployment-controller

e2e-ait-2f25c52f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2f25c52f-openshift-default-f6784b954 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-2f25c52f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2f25c52f

openshift-ingress

kubelet

e2e-migrate-9a86149a-gw-openshift-default-6458b4cb8-z6kcq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2f25c52f-7c96c64544

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2f25c52f-7c96c64544-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2f25c52f: serviceaccount "payload-processing-e2e-ait-2f25c52f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2f25c52f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2f25c52f-7c8bcfccfd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2f25c52f-7c8bcfccfd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2f25c52f-7c8bcfccfd-p4gj9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2f25c52f-7c8bcfccfd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2f25c52f-7c8bcfccfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2f25c52f: serviceaccount "payload-processing-e2e-ait-2f25c52f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2f25c52f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2f25c52f-7c96c64544 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2f25c52f-7c96c64544

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2f25c52f-7c96c64544-bbftd

openshift-ingress

multus

payload-processing-e2e-ait-2f25c52f-7c8bcfccfd-p4gj9

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f25c52f-7c96c64544-bbftd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2f25c52f-7c8bcfccfd-p4gj9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2f25c52f-7c8bcfccfd-p4gj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-2f25c52f-7c96c64544-bbftd

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f25c52f-7c96c64544-bbftd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f25c52f-7c96c64544-bbftd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2f25c52f-7c8bcfccfd-p4gj9

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:60564->10.132.0.59:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:60564->10.132.0.59:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f25c52f-7c96c64544-bbftd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2f25c52f-7c8bcfccfd-p4gj9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-ac4a75bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ac4a75bf

openshift-ingress

deployment-controller

e2e-derive-ac4a75bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb

SuccessfulCreate

Created pod: e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

openshift-ingress

multus

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ac4a75bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ac4a75bf-6dcf95dd86 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ac4a75bf-6dcf95dd86

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ac4a75bf-6dcf95dd86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ac4a75bf: serviceaccount "payload-processing-e2e-derive-ac4a75bf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ac4a75bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ac4a75bf-57657fc88 from 0 to 1

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ac4a75bf-6dcf95dd86

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ac4a75bf-6dcf95dd86-7k5pr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ac4a75bf-57657fc88

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ac4a75bf: serviceaccount "payload-processing-e2e-derive-ac4a75bf" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-ac4a75bf-6dcf95dd86-7k5pr

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ac4a75bf-57657fc88

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-gt5jn

openshift-ingress

multus

payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-gt5jn

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-gt5jn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-derive-ac4a75bf-6dcf95dd86-7k5pr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-ac4a75bf-6dcf95dd86-7k5pr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-ac4a75bf-6dcf95dd86-7k5pr

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-gt5jn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.001s (2.001s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-gt5jn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-gt5jn

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-ac4a75bf

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-ac4a75bf: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-ac4a75bf": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-ac4a75bf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d2ce286e-2edc-44c3-9726-fbfecaf26706, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ac4a75bf-57657fc88-gt5jn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-ac4a75bf-6dcf95dd86-7k5pr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-ac4a75bf-openshift-default-6bc76bcdcb-h44tq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-mt-cd17a221-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cd17a221-openshift-default-588ff7c78d from 0 to 1

openshift-ingress

multus

e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-cd17a221-openshift-default-588ff7c78d

SuccessfulCreate

Created pod: e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2

openshift-ingress

gateway_labeler_controller

e2e-mt-cd17a221

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cd17a221

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd17a221-65f777c97b-2mz2l

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cd17a221

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cd17a221-65f777c97b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd17a221-65f777c97b-2mz2l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd17a221-65f777c97b-2mz2l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-cd17a221-65f777c97b-2mz2l

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cd17a221-65f777c97b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cd17a221-65f777c97b-2mz2l

openshift-ingress

kubelet

payload-processing-e2e-mt-cd17a221-8657c965cd-jb7v5

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cd17a221-65f777c97b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cd17a221-65f777c97b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cd17a221: serviceaccount "payload-processing-e2e-mt-cd17a221" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-cd17a221-8657c965cd-jb7v5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cd17a221-8657c965cd-jb7v5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-cd17a221-8657c965cd-jb7v5

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cd17a221-8657c965cd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cd17a221-8657c965cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cd17a221: serviceaccount "payload-processing-e2e-mt-cd17a221" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cd17a221-8657c965cd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cd17a221-8657c965cd-jb7v5

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cd17a221

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cd17a221-8657c965cd from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-cd17a221-8657c965cd-jb7v5

Unhealthy

Readiness probe failed: dial tcp 10.133.0.38:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd17a221-65f777c97b-2mz2l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd17a221-65f777c97b-2mz2l

Unhealthy

Readiness probe failed: dial tcp 10.133.0.37:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-cd17a221-8657c965cd-jb7v5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-cd17a221-openshift-default-588ff7c78d-qdfh2

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-6757cc40-openshift-default-5795d7b75b

SuccessfulCreate

Created pod: e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n

openshift-ingress

deployment-controller

e2e-mt-6757cc40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6757cc40-openshift-default-5795d7b75b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-6757cc40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6757cc40

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6757cc40-5475cd9994

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6757cc40-5475cd9994-qsd62
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6757cc40-5475cd9994

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6757cc40-5475cd9994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6757cc40: serviceaccount "payload-processing-e2e-mt-6757cc40" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6757cc40-84997b996

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6757cc40-84997b996-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6757cc40: serviceaccount "payload-processing-e2e-mt-6757cc40" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6757cc40-84997b996

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6757cc40-84997b996-tnxp2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6757cc40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6757cc40-84997b996 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6757cc40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6757cc40-5475cd9994 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-6757cc40-5475cd9994-qsd62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6757cc40-84997b996-tnxp2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6757cc40-5475cd9994-qsd62

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6757cc40-84997b996-tnxp2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6757cc40-84997b996-tnxp2

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6757cc40-84997b996-tnxp2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-6757cc40-5475cd9994-qsd62

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6757cc40-5475cd9994-qsd62

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n

Created

Created container: istio-proxy
(x3)

openshift-ingress

kubelet

e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6757cc40-84997b996-tnxp2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6757cc40-5475cd9994-qsd62

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-6757cc40-openshift-default-5795d7b75b-2wb6n

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-59d5db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-59d5db

openshift-ingress

replicaset-controller

e2e-inf-a-59d5db-openshift-default-556766f6f6

SuccessfulCreate

Created pod: e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k

openshift-ingress

deployment-controller

e2e-inf-a-59d5db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-59d5db-openshift-default-556766f6f6 from 0 to 1

openshift-ingress

multus

e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-59d5db-65b8f8c948-qbx6l

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-59d5db-65b8f8c948

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-59d5db-65b8f8c948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-59d5db: serviceaccount "payload-processing-e2e-inf-a-59d5db" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-59d5db: serviceaccount "payload-processing-e2e-inf-a-59d5db" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb-m48mz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-59d5db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb-m48mz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb-m48mz

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-59d5db-65b8f8c948

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-59d5db-65b8f8c948-qbx6l

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-59d5db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-59d5db-65b8f8c948 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb-m48mz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb-m48mz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-59d5db-65b8f8c948-qbx6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-59d5db-65b8f8c948-qbx6l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-59d5db-65b8f8c948-qbx6l

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-accf7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-accf7d

openshift-ingress

deployment-controller

e2e-inf-b-accf7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4 from 0 to 1

openshift-ingress

multus

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4

SuccessfulCreate

Created pod: e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-accf7d-755887b768

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-accf7d-755887b768-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-accf7d: serviceaccount "payload-processing-e2e-inf-b-accf7d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-accf7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-accf7d-755887b768 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-accf7d-6b5cfb689b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-accf7d-6b5cfb689b-rv6dp

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-accf7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-accf7d-6b5cfb689b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-accf7d-6b5cfb689b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-accf7d-6b5cfb689b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-accf7d: serviceaccount "payload-processing-e2e-inf-b-accf7d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-accf7d-755887b768

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-accf7d-755887b768-nzs78

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-accf7d-755887b768-nzs78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-accf7d-6b5cfb689b-rv6dp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-accf7d-6b5cfb689b-rv6dp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-accf7d-755887b768-nzs78

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-accf7d-6b5cfb689b-rv6dp

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-accf7d-6b5cfb689b-rv6dp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-accf7d-755887b768-nzs78

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-accf7d-755887b768-nzs78

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-59d5db-84d95c66fb-m48mz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-59d5db-65b8f8c948-qbx6l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-59d5db-openshift-default-556766f6f6-nrn2k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-accf7d-6b5cfb689b-rv6dp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-accf7d-755887b768-nzs78

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-dc9ec3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-dc9ec3

openshift-ingress

deployment-controller

e2e-api-a-dc9ec3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-dc9ec3-openshift-default-d6fc9c854 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-dc9ec3-openshift-default-d6fc9c854

SuccessfulCreate

Created pod: e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

openshift-ingress

multus

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd-mvjlf

openshift-ingress

multus

payload-processing-e2e-api-a-dc9ec3-b47cd6f6b-k2l78

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dc9ec3: serviceaccount "payload-processing-e2e-api-a-dc9ec3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd-mvjlf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd-mvjlf

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-dc9ec3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dc9ec3-b47cd6f6b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-dc9ec3-b47cd6f6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dc9ec3: serviceaccount "payload-processing-e2e-api-a-dc9ec3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dc9ec3-b47cd6f6b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-dc9ec3-b47cd6f6b-k2l78

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-dc9ec3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-dc9ec3-b47cd6f6b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc9ec3-b47cd6f6b-k2l78

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd-mvjlf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd-mvjlf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc9ec3-b47cd6f6b-k2l78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc9ec3-b47cd6f6b-k2l78

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-0e0fe5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0e0fe5-openshift-default-67bb5b7444 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-0e0fe5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0e0fe5

openshift-ingress

replicaset-controller

e2e-api-b-0e0fe5-openshift-default-67bb5b7444

SuccessfulCreate

Created pod: e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0e0fe5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0e0fe5: serviceaccount "payload-processing-e2e-api-b-0e0fe5" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0e0fe5: serviceaccount "payload-processing-e2e-api-b-0e0fe5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd-4vwlt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0e0fe5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd-4vwlt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd-4vwlt

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb-hn8b8

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd-4vwlt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd-4vwlt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb-hn8b8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb-hn8b8

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb-hn8b8

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb-hn8b8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc9ec3-9ddc7bbd-mvjlf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc9ec3-b47cd6f6b-k2l78

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-dc9ec3-openshift-default-d6fc9c854-mdxk6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-0e0fe5-5bdbdb7cb-hn8b8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0e0fe5-59f77594bd-4vwlt

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-a60880

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-a60880

openshift-ingress

deployment-controller

e2e-shared-a-a60880-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-a60880-openshift-default-6bf448584 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-a60880-openshift-default-6bf448584

SuccessfulCreate

Created pod: e2e-shared-a-a60880-openshift-default-6bf448584-khph7

openshift-ingress

kubelet

e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-a60880-openshift-default-6bf448584-khph7

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-a60880

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-a60880-6c5fff5886 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-a60880

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-a60880-7846f4db76 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-a60880-6c5fff5886

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-a60880-6c5fff5886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-a60880: serviceaccount "payload-processing-e2e-shared-a-a60880" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-a60880-7846f4db76

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-a60880-7846f4db76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-a60880: serviceaccount "payload-processing-e2e-shared-a-a60880" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a60880-7846f4db76-nc6j5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-a60880-6c5fff5886

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-a60880-6c5fff5886-mcrkd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a60880-7846f4db76-nc6j5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a60880-6c5fff5886-mcrkd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a60880-7846f4db76-nc6j5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-a60880-7846f4db76-nc6j5

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a60880-6c5fff5886-mcrkd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a60880-6c5fff5886-mcrkd

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-a60880-6c5fff5886-mcrkd

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-a60880-7846f4db76

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-a60880-7846f4db76-nc6j5
(x2)

openshift-ingress

kubelet

e2e-shared-a-a60880-openshift-default-6bf448584-khph7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-a60880-openshift-default-6bf448584-khph7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-a60880-openshift-default-6bf448584-khph7

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-a60880-openshift-default-6bf448584-khph7

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-a60880-openshift-default-6bf448584-khph7

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-601aa9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-601aa9

openshift-ingress

deployment-controller

e2e-shared-b-601aa9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-601aa9-openshift-default-567c59bb96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-601aa9-openshift-default-567c59bb96

SuccessfulCreate

Created pod: e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

openshift-ingress

multus

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-601aa9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-601aa9-685f844dfd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-601aa9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-601aa9-78687d6f44 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-601aa9-78687d6f44

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-601aa9-78687d6f44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-601aa9: serviceaccount "payload-processing-e2e-shared-b-601aa9" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-601aa9-685f844dfd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-601aa9-685f844dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-601aa9: serviceaccount "payload-processing-e2e-shared-b-601aa9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-601aa9-78687d6f44

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-601aa9-78687d6f44-d7rqb

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-601aa9-685f844dfd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-601aa9-685f844dfd-fljl2

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-601aa9-78687d6f44-d7rqb

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-601aa9-685f844dfd-fljl2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-601aa9-78687d6f44-d7rqb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-601aa9-78687d6f44-d7rqb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-601aa9-685f844dfd-fljl2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-601aa9-78687d6f44-d7rqb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-601aa9-685f844dfd-fljl2

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-601aa9-685f844dfd-fljl2

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-a-fb0399-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-fb0399-openshift-default-6c64774b7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-fb0399

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-fb0399

openshift-ingress

replicaset-controller

e2e-ipp-a-fb0399-openshift-default-6c64774b7b

SuccessfulCreate

Created pod: e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

openshift-ingress

multus

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-fb0399

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-fb0399-68bbd99f48 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fb0399-68bbd99f48

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-fb0399-68bbd99f48-th924

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-fb0399

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6-z6vtf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fb0399: serviceaccount "payload-processing-e2e-ipp-a-fb0399" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fb0399-68bbd99f48

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-fb0399-68bbd99f48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fb0399: serviceaccount "payload-processing-e2e-ipp-a-fb0399" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6-z6vtf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-fb0399-68bbd99f48-th924

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6-z6vtf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fb0399-68bbd99f48-th924

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6-z6vtf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6-z6vtf

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fb0399-68bbd99f48-th924

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fb0399-68bbd99f48-th924

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6488bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6488bc

openshift-ingress

multus

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-6488bc-openshift-default-dd7c889d

SuccessfulCreate

Created pod: e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

openshift-ingress

deployment-controller

e2e-ipp-b-6488bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6488bc-openshift-default-dd7c889d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6488bc-6dbf565b78-5cptz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6488bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6488bc-6dbf565b78 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948-8t4jq

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6488bc: serviceaccount "payload-processing-e2e-ipp-b-6488bc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948-8t4jq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948-8t4jq

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-6488bc-6dbf565b78-5cptz

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6488bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6488bc-6dbf565b78

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6488bc-6dbf565b78-5cptz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6488bc-6dbf565b78

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6488bc-6dbf565b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6488bc: serviceaccount "payload-processing-e2e-ipp-b-6488bc" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6488bc-6dbf565b78-5cptz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6488bc-6dbf565b78-5cptz

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948-8t4jq

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948-8t4jq

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-7720d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

openshift-ingress

multus

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-7720d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-7720d1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764-lc6jh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-7720d1: serviceaccount "payload-processing-e2e-ipp-cleanup-7720d1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-7720d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-7720d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58-xc6pr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-7720d1: serviceaccount "payload-processing-e2e-ipp-cleanup-7720d1" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58-xc6pr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58-xc6pr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764-lc6jh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764-lc6jh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58-xc6pr

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58-xc6pr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764-lc6jh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764-lc6jh

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7720d1-6f88f6c764-lc6jh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7720d1-8576c6fd58-xc6pr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fb0399-68bbd99f48-th924

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fb0399-785f5849f6-z6vtf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6488bc-6dbf565b78-5cptz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6488bc-55d7ddc948-8t4jq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-6488bc-openshift-default-dd7c889d-ptsts

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-a60880-6c5fff5886-mcrkd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-a60880-7846f4db76-nc6j5

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-a60880

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-a60880: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-a60880": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-a60880, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cc78b237-6c37-4774-9dfb-975280f4ca73, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-a60880-openshift-default-6bf448584-khph7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-601aa9-78687d6f44-d7rqb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-601aa9-685f844dfd-fljl2

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-601aa9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-601aa9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-601aa9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-601aa9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dd6a348a-bdee-4610-9cca-27b657a814cd, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2

Killing

Stopping container istio-proxy